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Preface 



The Instructional Dimensions Stud/tlDS) Con- 
ference ofKi this volume reflect the cooperative 
effort of controctorsi local school system person- 
nel, and the National Institute of Education (NIE) 
staff. 

Special thanks ore due to Kirschner Associ- 
ates, Inc., for ossisting NIE in identifying teacher 
participants and to the National Institute for 
ComnrKinity Development for providing important 
planning and support services during the confer- 
ence. 

Throughout the study, local school systems 
facilitated the IDS research effort. The teachers 
who participated in the conference provided many 
vduoble insights, which were used by the authors 
in drafting their papers. 



Michoel Cohen, Joe Dominic, Nellie Sontiogo- 
Walpow, and Marcia Whiteman of NIE acted as 
symposium leoders for the working sessions. In 
this capacity, they helped clarify the principal 
issues and also contributed substantively to the 
overall conceptualization of^the IDS Conference, 
The conference was designed by Peirce Hammond 
Richard Moss was Project diFficer for the confer- 
ence, assisted by Karen McKee. Joy Frechtling, 
Peirce Hanwviond, Richard Moss, and Margot 
Nyitray read and suggested revisions for the 
papers. Their comments and Cathy l-k>dgman*s 
special contributions to the clarity of presentation 
helped to better integrate the ideas of the 
individual papers. Each paper reflects the 
opinions of its author; the views expressed do not 
represent those of NIE or of the Deportment of 
Health, Education, and Welfare. 
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Chapter!. Introduction 



Title I of the Elementar/ and Secondary 
Education Act Amendments of 1974 instructed the 
National Institute of Education (NIE) to conduct 
on evaluation of compensatory education. One, 
component of this st jdy was an examination of ' 
the effects of co?npensatory education services on 
children. NiE's major effort in this area, the 
Instructional Dimensions Study (IDS), examined 
teaching practices in o selected sample of class- 
rooms to determine both whether current practic- 
es can be effective and how they might be 
improved. Reports on the IDS were issued in 1977 
(Kirschner Associates, Inc., 197/) and sent to 
Congress last year (NIE, 1977). 

JnIIE's overall mission includes two major goals. 
The first, prompting educational equity, was 
served by the reports mcde to Congress on the 
Cofnpensatory Education Svudy, including IDS. In 
an effort to forward the second, improving educa- 
tional practice, by- relating IDS findings to some 
of the teachers who participated in the study and 
by considering and reporting their responses to it, 
NIE convened the IDS Conference in April 1978. 
Participating teachers were selected frorn among 
about 600 who hod participated in the study. 
Teachers who employed a variety of teaching 
practices- were included. Also attending the 
conference were nine educational researchers, 
selected to provide different educational perspec- 
tives. The researchers were charged with record- 
ing the conference proceedings and integrating 
the views of the teachers with the findings of 
educatiooGl research. 

This vplume presents the product of their 
efforts. Included are both an overall summary of 
conference proceedings and individual papers dis- 
cussing issues in each of the four areas on which 
the conference focused: opportunity to learn; 
iristructional setting; planning, organization, and 
management; and individualization of instruction. 

A summary of the IDS and its findings is 
presented below. This summary provided the 
context for the conference and affords necessary 
background to the papers presented here. 

During the 1976-77 school your, NIE examined 
instructional proctices in 400 selected classrooms 
in 100 schools in 14 local educational agencies 
(LEAs) in the United States. The IDS assessed the 
effects on achievement of reoding and mathe- 
matics instruction provided to comptnsatory 



education students in 1st and 3d grades in these 
classrooms. Participating schools were in rurol, 
suburbon, and urban areas, differed in economic 
levels, and were, as a whole, representative of the 
national ethnic composition. Selected schools also 
characteristically had well-implemented instruc- 
tional programs, although the programs them- 
selves varied. They ranged in approach from 
hijhiy individualized diagnostic and prescriptive 
programs to tradihonoi whole-class instruction. 

Particular classrooms were chosen to reflect 
variation in the degree of individualization of 
instruction as measured by the use of (I) behavior- 
al objectives, (2) individual pacing, (3) individual 
sequencing, and (4) diagnostic and mastery testing 
and prescriptive techniques. In addition, it was 
generally required that in selected classrooms 
there be teachers who had previous experience in 
the instructiojiol practices studied. 

Interviewers gathered data on actual class- 
room practices and teacher background. In order 
to measure the extent to which classroom instruc- 
tion overlopped with the content of achievement 
tests, researchers analyzed the curriculun 
materials used by participating teacher.. 
Videotape recording was used to examine those 
teacher-student interoctions which would be diffi- 
cult to measure through interviews (for example, 
frequency of individual or small-group instruction; 
proportion of management statements to cogni- 
tive/instructi'.>nal statements). The amounts and 
proportions of "supplemental instruction were doc- 
umented by office rosters. The standard for 
comparison of the effectiveness of the various 
instructions practices was the Comprehensive 
Test of Basic Skills (CTBS). 

The results of the IDS fall into the four areas 
described below: 

• First, the opportunity to learn provicied by 
relatively high amounts of instructional 
time and emphasis on the skills on which 
achievement gains were measured were 
important factors in high achievement 
gain. 

• Second, in-class or mainstream instruction 
proved more effective than out-of-class or 
pullout instruction for 1st graders in read- 
ing and in mathematics and for 3d graders 



in reoding. However, setting was not a 
significant foctor for 3d-grade mathe- 
matics instruction. 

• Third, the overall results of the study were 
encouraging about the general effective- 
ness of compensatory instruction in well- 
planned and well-implemented programs* 

• Fourth, the results did not show individual- 
ized instruction to be uniquely effective. 
Generally, individualized classrooms were 
neither more nor less effective than class- 
rooms which were relatively nonindividual- 

. ized. 

Opportunity 

The IDS examined two types of opportunities 
given to students. The first, opportunity to learn, 
can roughly be translated into instructional time. 
It included measures of length of schoolday,c 
amount of regular ond supplemental reading and 
math instruction, attendance, class and group 
size, prop>ortion of stodents working "on task," and 
amount of homework. 

Research evidence shows that increased 
instructional time is associated with increased 
learning, but the way time is spent is also 
important. Sonrie evidence illustrates that "direct 
instruction" is one effective way of using instruc- 
tional time. 

The second type of opportunity, opportunity to 
demonstrate learning, is based on the premise that 
what is learned depends on what is taught. This 
rather simple assumption implies that programs 
will appear to be more successful when the 
content of the test materials is closely related to 
curricular content of the instructional program. 

The IDS found that instructional time was an 
important determmont of achievement gain and 
that when instruction emphasized the porticular 
skills on which achievement gains were measured, 
student ochievement gains were especially large. 
Each of these findings was more pronounced for 
1st grade than for 3d grade. 

Setting 

The question of wh^re supplemental (compen- 
satory) education should be provided is contro- 
versial. The two rnojor alternatives examined by 
IDS were (I) in-class or mainstream instruction 
and (2) but-6f-class or pullout instruction. The 
controversy about setting has two aspects. 

First, some States and districts mandote the 
use of pullout programs because they;believe that 



the Title I regulations require it or because they 
want to Illustrate clearly the existence of a 
special program for designated students by phys* 
ically isolating it from the regular classroom; The 
NIE National Survey of Compensatory Education 
found' that pullout instruction predominates 
nationally for compensatory reading instruction.. 
In 1st grade, pullout services were delivered. to 
64% of the compensatory education students 
receiving reading and 28% of those receiving 
mothematics. In 3d grade, tbe figures were 74% 
and 57%, respectively. The Title I regulations do 
not, in fact, require pullout programs, but they do 
require a special program for designated students. 
Since models of allowable mainstream pri>grams 
have not been disseminated widely. States and 
districts concerned about the legality of their 
programs and abou^t the risks of program audits by 
the U.S. Office of Education have often mandated 
or designed pullout programs to assure legality 
and minimize the risk of audit exceptions. 

The second aspect of this controversy is 
pedagogical. Which setting, if either, benefits the 
Title I students more? Or, putting it negatively, 
does either setting tend to harm students in some 
fashion? Advocates of each of these two 
approaches make claims about the effectiveness 
of pullout and of mainstream instruction. Some 
believe that pullout instruction may make 
instruction easier by allowing students of approxi- 
mately equal abilities and skills to be instructed 
together. Others believe that pullout instruction 
may facilitate de facto segregation or resegrega- 
tion; that it may encourage tracking; that it may . 
stigmatize the children who are pulled out; and 
that it may make coordinating regular and com- 
pensatory instruction more difficult. 

Some believe that mainstream instruction may 
focilitate the coordination of regular and compen- 
satory instruction; that it may use financial 
resources more effectively; and that if may allow 
greater positive peer influences because of the 
impact of "good" students on Title I students. 
Others believe that mainstream instruction may 
make it harder to meet the needs of individual 
students; that it may allow instructional patterns 
which have led to failure to be repeoted during 
compensatory instruction; and that it may embar- 
rass Title I students because they receive this 
extra instruction in the presence of their peers. 

To date, research evidence is inconclusive on 
most of these topics, although some suggest that 
ability grouping ("homogeneous grixiping," or 
tracking) is detrimental to the achievement gains 
of average and below-average students. The 
question of effects of setting on achievement is a 
separate but related question. It is possible, for 
example, to use ability grouping in both main- 
stream and pullout settings. 
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The IDS found that Ist graders gained most in 
moinstream settings in reading (13 months or 17 
percentile points vs 12 months or II percentile 
points) and in nrxithenriatics (13 months or 20 
percentile points vs 1 1 months or 7 percentile 
points). Third graders gained most in mainstream 
reading (10 monitis or 13 percentile points vs 7 
months or 8 percentile points), but mathematics 
gains were equol in the two settings (12 months or 
17 percentile points). 

Planning, Orqonizatioh, and Management of Co n- 
pensatory Instruction 

The research results are generally encouraging 
about the effectiveness of. compensatory educa- 
tion programs examined in this study. Overall, 
students in grade I made average gains of 12 
months in reading and 1 1 months in moth during 
the 7 months between foM and spring testing os 
measured by the CTBS. Third groders^ gained 7 
months in reading and 12 months in moth on the 
CTBS. These goins exceed those reported in the 
most positive recent evaluations of compeiisatpry 
instruction. Contributrng to these results may be 
certain special features of the selected districts 
and classrooms: districts were nominated because 
they had well-implemented programs, and class- 
room teachers were generally included only if 
they were experienced in giving a particular type 
of instruction (ranging from individualized diag- 
nostic and prescriptive instruction to more 
traditional whole-<:lass instruction). 

Although these classrooms were not special 
demonstration projects, they were better planned, 
organized, or managed thon is typical of class- . 
rooms serving similar students. While teacher 
bockgrouruly including teaching experience, formal 
.education, and anrK>unts of various kinds of recent 
inservice training, was not relat<^ to achievement 
gain within the study, there stilt may be aspects 
of teacher bockground (such as organizational 



skills) which distinguish the study sample as a 
whole from teachers in general. » 

Individualized Instruction 

The IDS examined individualization of instruc- 
tion for two reasons. First, Congress expressed 
explicit interest in it. Second, there was o 
substantial amount of research work indicating 
that such features of individualized programs as: 

• clearly stated behayiorol objectives which 
take individiol students in small steps 
through curriculum materials; 

• instruction which bears directly on the 
objectives; 

• structured, sequential instruction; 

• high-intensity, closely supervised 
instruction; 

• individual diagnosis and prescription; 

• individual or small-group instruction; and 

• flexible grouping 

were often associated with achievement gains 
greater than those of programs lacking such 
features. Further, many educators and 
educational researchers currently believe strongly 
in the effectiveness of "direct instruction," for 
example, instruction characterized by these 
features. 

Study findings did not, however, show individu- 
alized classrooms to be uniquely effective. The 
IDS results showed substantial gains in reading and 
nDothemotics achievement irrespective of the 
presence or absence of individualization as de- 
fined for this stud/. 
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Chapter II. Overview of the Instructional 
Dimensions Study Conference 



Nel N 
Stanford 



In 1 974, Congress directed the Notional Insti- 
tute of Education (NIE) to examine the purposes 
and operation of Title I of the Elementary and 
Secondory Education Act of 1965. The Congres- 
sionol mandate to NIE has been characterized in 
terms of two principal questions: How effective 
ore compensatory education programs in meeting 
their basic purposes? What phonges might be 
mode to improve the effectiveness of compensa- 
tory education programs? ' 

In attempting to answer these questions, NIE 
developed a strategy for research that involved on 
examination of four rnajor areas: funds alloca- 
tion, service delivery, student development, and 
program administration. The Instructional Dinr>en- 
sions Study (IDS) was designed as port of the study 
of student development. The IDS Conference was 
convened to supplenient the information presented 
in the study and to aid policymakers in interpret- 
ing that information. 

conference brought toother 40 teachers 
who had participated in the IDS and invited them 
to discuss the study's findings and to contribute 
information and suggestions they hod gained in 
their own professional work with Title I. As NIE 
D^uty Director Michoel Timpone pointed out in 
his opening remarks, the conference marked 
another significant effort in NIE's continuing 
campaign "to improve the practice of education as 
art, science, and profession." Researchers, he 
said, could say quite o lot about education as 
science, but teachers were needed to. describe and 
suggest improvements in education ds art and 
profession. His remarks proyed correct. . The 
views expressed by the. conference teachers dif- 
fered dramatically from those of researchers. But 
the difference provides a complementary, view, 
one that fills out the ^ientific skeleton of 
research, and not o contradictory one. 



A description of the history and purposes of NIE's 
efforts to examine Title I programs nrKiy be found 
in The Effects of Services on_ Student - 
Development, September I977« oh NIE publica- 
tion avoiloble from The Notional Institute of 
Education, Washington, D.C. 20208. 
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In this overview, our nrwin purpose is to 
describe the conference itself. To do that lucidly, 
however, something must be said about the IDS. 
For a fuller description, the reader is again 
referred to The Effects of Services on Student 
Developtnent. 

In designing the IDS, researchers took into 
account two well-known facts about recent 
research: first, global assessments of 
compensatory education programs hove not been 
very useful— partly because of ambiguities in the 
interpretation of their findings, and partly 
because they hove failed to establish any con- 
nection between success and particular program 
features which might have produced that success. 
Second, not all desirable outcomes ore equally 
measurable. Instruments exi3t, for example, by 
which we can measure "self-image" and attitudes, 
but there is considerable disagreement over what 
the instruments actually measure, and the instru- 
ments frequently display a lock of sensitivity and 
discriminatory power. Hence, IDS researchers 
decided to narrow the focus of the study and to 
concentrate upon trying ' to find connections 
between particular program features and achieve- 
ment in mathematics and reading. Adequate 
measurement instruments exist for both areas, 
and it is . generally agreed that both subjects are 
crucial in scholastic development. 

A major difference in priorities between 
researchers and teocViers became obvious immedi- 
ately. Researchers, in order to do "good science," 
must strip away complexity, and attempt to 
control variables and establish hypothetical 
connections. Teachers, looking dt the some 
situation, embrace the complexity and choose for 
their area of concentration features of the pro- 
gram which seem to be the murkiest scientifical- 
ly. Interestingly, as Botel and Hawkins point out 
in their papers, teachers think that state and 
district policymakers also oversimplify. This 
trend toward what teachers see as oversimplifica- 
tion is partly o product of the accountability 
movement and its functional dependence on 
behavioral objectives. Thus, while a district guide 
may state its aims for reading in terms of specific 
decoding skills and vocabulary attainment, teach- 



ers are likely to aim for voluntary and self- 
selected reading, for pleasure In silent reading, 
and for^ social outcomes resulting from shared 
experiences m /reading. Are teachers wrong to 
' pursve such alms? Should they concentrate on the 
more specifically stated and narrowly f6cused 
objectives? Are researchers wrong In theit effort 
to circumscribe and control? Probably the answer 
to all three questions is no. But it must be kept In 
' mind that sharply contrasting views follow from 
these very different sources. 

The IDS focused on selected reading and 
mathematics programs in 1st and 3d grades, and it 
concentrated on two questions: Is compensatory 
instruction more effective in mainstream op pull* 
out settings? What classroom procedures are 
related to significant student achievement? The 
study, then, consists of four major areas: (I) 
opportunity to learn, (2) setting for instruction, 

(3) planning, organization, and management, and 

(4) individualization of instruction. 

The IDS Conference was organized into four 
workshops treating these topics. From this point 
on, /this summary is also organized around the four 
topics, and further description of the definition's, 
variables, hypotheses, interpretations, etc., will 
be undertaken in each of the subsummaries. ^.^ 

Opportunity to Learn 

"Opportunity is the chance of obtaining, or the 
occess one has to, a valued resource." (See 
Leinhardt's paper, p. 1 5.) The concept of oppor- 
tunity, OS Leinhardt states, has been an economic 
and. political one. As qn educational corcept/it 
holds some promise, but it also introdu<;es some 
difficulties. Consider, for example, a hypothe- 
tical case of students who ore exposed^ to an 
acceptable number of minutes of instruction in 
subject X but fall to attend to the instrijction 
effectively because of, say, language difficulties. 
HoW shall we measure their opportunity to learn? 
Or, suppose children spend a significorift portion of 
their time, os they sometimes do in highly 
Indlvldjoiized programs, doing the wrong thing— 
practicing their errors, failing to follow printed 
instructions, using a faulty heuristic. How much 
of their time should be counted as "opportunity to 
learn"? 

It is clear that a concept of opportunity which 
uses amount of instructional time (either allo- 
cated or engaged) presupposes a certain level of 
proficiency on the part of the teacher: that the 
teacher will choose methods at least reasonably 
likely to be effective with given students, that the 
teacher will be able to supervise closely enough to 
ensure that "procticing errors" will not be a 
common occurrence. The IDS did, indeed, concen- 
trate its attention on reasonably proficient teach- 



ers and occordlngly successful outcomes. Hence, ' 
one can reasonably ask: What is the effect of 
increasing instructlonol time on student achieve- 
ment? r 

The IDS included as variables In its measure- 
ment of "opportunity": class size, minutes per 
week of instruction, time students spend on task, 
and overlap between the curriculum (things octu- 
olly taught) and test content* The last variable, 
"overlap," , is interpreted as a measure of "oppor- 
tunity to ctemonstrote learning." For all groups of 
students, overlap correlated positively with 
achievement. | 

Teochers at the conference were asked how 
much time they sc|ieduled for reading and nrwth 
and what sorts of strategies they used to increase 
instructional time when they thought it was 
necessary to do so. Many replied that time for 
reading and mathematics was mandated by State 
or district. Therefore, allocated time for these 
subjects was fixed. But it turned out that for 
many of these teachers, reading instruction per- 
vaded the day's instructional activities. In social 
studies and science, for example, teachers spent 
time on specific reading instruction. The slogan 
"Every teacher is a reading teacher" was taken 
seriously by the conferees. It is therefore 
difficult to determine exactly how much time is 
spent on reading instruction in any giyen situation. . 

The difference in viewpoint between teachers 
and researchers (and, soy, a district's behavioral ly 
stated goaJs) mokes it difficult for the careful 
researcher to pinpoint "minutes of instructional 
time." The conference teachers, for example, 
took time from "actual reading" to allow students 
to express themselves, share experiences, and 
choose their own learning paths. To the teachers, 
these activities were essential and integral parts 
of reading instruction; to the researchers, they 
were "time out" from direct instruction in reading 
skills. Thus, there was a basic conflict between 
teachers and researchers over both quantity and 
quality of "instructional time" and "engaged 
time." (See Zimiles, p. 25 and p. 26.) 

Teachers generally rejected suggestions that 
an increase in instructional time be achieved by 
lengthening the schoolday or school year, by 
taking time from other subjects, or by Increasing 
the pace of instruction. (See Leinhardt, pp. 16, 
17, 18.) Indeed, they were concerned about the 
fact that Title I children often missed social 
studies, science, or music in order to receive 
supplemental instruction in moth and reading. To 
prevent this "missing out," some teachers even 
used, the time when Title I children were "pulled 
out" Jor enrichment in the areas of reading or 
moth with their regular students. In these special 
circumstances, the scientific conditions ore fur- 
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thfer confounded* Can the Title I children be soid. 
to receive "supplemental instruction" if other 
children ore also receiving special additional 
instruction? And,, if children receive very 
particular help in reading ossacJated with social 
studies and science, is it not possible thot Title ! 
children are actually sometimes missing a vital 
segment of the instructional package? It should 
be possible to work out some sort of scheme by 
which Title I children with a certain mix af skills 
would study the regular social studies and/ar 
science and those with another mix receive 
continued instruction in general decoding skills* 
At the present time, aur knowledge appears to 
lock the fine tuning required for such a scheme. 

The conference teachers named organizational 
matters as a major doctor decreasing instructionoJ 
time. Motivating, disciplining, listening, sharing, 
and "laving" were all considered integral to the 
instructional process. But testing, moving large 
numbers of children here and there, recording 
progress on special cords, writing out prescrip- 
tions—the vast sum of clerical and logistical 
tasks—were seen as tasks in conflict with the 
instructional process. Many teachers seemed to 
hove at leost partially resolved this problem with 
the help of sympathetic administrators by con- 
stontly paring away at the mountain of paperwork. 
Those with less administrative support felt that 
the superficial appearance af accomplishing some- 
thing hod higher priority in their schools than did 
actual contributions to students* achievement and 
wel l-being. 

In the matter of pacing and sequencing, we 
find on interesting anomaly, Leinhordt cites a 
considerable body of research on "timing" and 
"pocing," but teachers seem to go at the matter 
intuitively or traditionally. Thus, moth and 
reading ore taught when "long" blacks of time con 
be counted on. One "moves on" when students 
show signs of being ready to do so. Indeed, 
discussion at most of the Opportunity Workshops 
barely touched on matters of sequencing and tim- 
ing, focusing, rather, on strategies for increasing 
instructional tinne or on testing as port of "curric- 
ulum overlopl" Teachers might profit from 
responsible suggestions and reliable informotian 
about timing and pacing. 

An interesting feature of the talk about 
instrucHonol time centered on -'the problem of 
keeping children on- task. Teachers faund one-to- 
one strategies relatively ineffective with Title I 
students because children are left to work by 
themselves for long periods of time while the 
.teocher works with other individuals* They found 
it easier to keep children on-task Tn small groups 
where questions can be asked and answered 
collectf- ' ond where peer support con keep 
things , when the teacher nrioves to another 



group* Again, teachers emphasized the socializing 
effects of smqil groups and the opportunities far 
children to be recognized and helped by their 
peers* Teachers grouped and regrouped, strug- 
gling to find 0 balance thot would permit a high 
degree of personalization together with the nece- 
ssary level of monitoring. Too large q group 
meant a sacrifice in personalization and a level af 
monitoring aimed at the I awer half af the group;^ 
too small o group meant many children neglected 
and on increase in random behavior. 

During the discussion on curriculum overlap, it 
became clear that teachers hod o host of gripes 
about testing. (See Zimiles^ pp. 25 and 29.) 
Sometimes there was so much testing that it 
invaded time teachers sow as instructional time. 
Sometimes too much emphasis was placed on tests 
and not enough" on features of the curriculum 
which resist accurate measurement. And some- 
times tests incorporated items with which 
children were unfamiliar because of their geo- 
graphical location or social status. • Arizona 
children, far example, do not se^ rivers of the 
Pennsylvania sort, and Florida children ore gen- 
erally unfamiliar with snow gear. 

Most of the teachers recognized the potential 
value and necessity of standardized testing but 
felt that committees of teachers representative 
of various geographical locations should be • 
involved in the process af constructing test items. 
Teachers, informed af the concept being tested, 
could suggest farms for the particular items that 
would nat prejudice the performance of young- 
sters from their area. 

Finally, there was on important question about 
the desirability of complete curriculum overlap. 
Surely, it is obvious that people ore likely to test 
better on material they hove specifically learned, 
than on material they hove not addressed directly. 
But teachers pointed out thot many of the 
abilities we value most, such as critical thinking, 
general problem salving, and aesthetic and moral 
sense, cannot be taught directly. Yet we feel that 
these abilities ore largely acquired and enhanced 
in sensitive ( and enduring teaching/learning relo- 
tionships. We wont to teach for these outcomes, 
but we cannot teach them directly. It appears 
that teachers wont tests that will measure these 
important effects, or, if such tests ore not 
available, they wcsnt policymakers to understand 
that sorr>e vitally important educational goals ore 
not being ossessed by the tests that ore presently 
administered. 

Setting far Instruction 

The workshop on setting induced some of the 
liveliest debate of the conference. It also aroused 
argumentation among the recorders, and one con 
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see evidence of thot arousal In the papers of this 
volume. 

The question addressed by the IDS was this: Is 
compensotory Instruction more effeotive in pull- 
out or in iriarnstreom settings? Pullout instruction 
was defined os supplenrvsntol instruction delivered 
to students outside the regular classroom. Main- 
stream instruction, was defined as supplemental 
Instruction delivered within the regular classroom. 
The IDS findings indicated that "mainstredming" 
was more effective in Ist-grdde reading and 
mathematics and 3d-grade reading, and that the 
settings produced about equal results in 3d-grade 
matliei^atics. 

Controversy arose first over the terms them- 
selves. "Mainstreaming," a^ an eckicational term, 
is used primarily in the domain of special educa- 
tion. To "mainstream" on educationally 
handicapped child has meant to place him/her in a 
regular (as opposed to special) class. Some 
; children might be "moinstreamed," for example, in 
mathematics, others in social studies. For the 
rest of the day, these children would return to 
their special class to study with their specially 
trained teacher. In recer.t years, "maihstreaming" 
has meant returning large numbers of children 
who hove been assessed as educationally handi- 
capped (EH) to regular classrooms. This practice 
has caused heated controversy, those favoring 
"moinstreaming" cloin) that it removes the stigma 
of EH clossif icntion;^ those objecting to_mair»- 
streaming claim that the practice ignores all we 
hove, learned about teaching EH students and 
destroys a program which is just beginning to bud 
into 0 science.^ 

To use the word "mainstream," .then, was to 
borrow trouble. But there are further problems. 
Roger Shuy accurately reflects the teachers* 
questions when he asks what, the vital difference 
is between pullout and mainstream settings. 

The claims usually mode in favor of main- 
streaming ore these: children ore likely to feel 
that they are "different" if they are "pulled out" 
for special instruction; children often miss 
important subjects such as science and social 
studies when they ore pulled out; mainstreaming is 
less expensive than pullout; and finally, 
mainstreaming is just as effective as pullout. The 
conference teachers offered arguments to counter 
eoch of these claims. (For a more complete 
summary of the , arguments ^on each side, see 
Kennedy's paper.) Let's consider some of the 
teachers' arguments. 



Some of this debate con be reviewed in the 
summary of the/NIE Curriculum Development 
ConfercyKe, November 1976. The summary is 
available from NIE. 



Perhaps children feel stigmatized when they 
ore "pulled out" of their regular classrooms for 
special Instruction. Most of the conference 
teachers felt that this was not a large problem, 
Sonnetinnes, . they said, children did feel like 
"dummies" when they were pulled out, but more 
often they knew themselves that they wefe having 
academic difficulties and they appreciated the 
special help. Sometimes whole classes needed 
counseling on the matter, and such counseling 
constituted a learning experience for all the 
children. (See Kennedy, p. 3^.) Further, as 
teachers pointed out, grouping takes place even in 
mainstream situations, so it is moinjy a matter of 
emphasis. ' 

. To assess the arguments here is very difficult. 
Again, borrowed trouble creeps in. Arguments for 
and against "tracking" have raged for years, and 
pullout looks suspiciously like tracking. Many 
school systems have abandoned tracking, albeit 
with some reluctance, «>because it has seemed to 
^them that its pernicious side effects (damage to 
the self-image of lower track students and rabid 
competition among upper track students) out- 
weiglied its advantages (efficiency in teaching and 
student intellectual compatibility). Given this 
background, it is small wonder that feelings are 
aroused on the issue. But it must be kept in mind 
that grouping is an almost universally accepted 
practice, and, provided it does not segregote 
children for extended periods (e.g., whole^ys in 
a given year, a whole year in a given subject), it is 
not considered "tracking" but a responsible and 
respectable arrangement for instruction. Most of 
the . conference teachers were involved in pullout 
prograns, and they said that stignrKitization was 
not a problenri unique to pullout. It occurs at 
times in mainstream programs as well. It is not 
setting that aggravates or relieves the feeling of 
being different, but the sensitivity or insensitivity 
of teachers working with the Title I students.-^' 

Do ^children miss something when they are 
pulled, out? This is another tough question. Shuy 
points out tiiat, by and large, the conference 
teachers seemed not to be greatly concerned 
about that possibility. It is recorded, however, 
that some teachers felt so strongly about the 
potential loss that they provided enrichment for 
their regular students and "saved" the social 
studies, science, or whatever, for times when the 
children were together. Others, some Title I 
specialists, spoke of providing experiences in 
these subjects for Title I children within their 
special instruction. These experiences, it must be 
noied, were relatively rare. 

For the nriost port, a pragmatic attitude 
prevailed among the teachers. It is better, they 
seemed to feel, to miss a little something now 



than tami$s out on edixrotron entirely. One must 
learn to reod and to ck> mathematics. 

Is mainstr earning tess expensive than puJIaut? 
Under most definitions, the answer to this seems 
- ta be yes. It requires leds spatCf, can sometimes 
be accomplished with aides, and Is easier ta 
coordinate'. But one must look hard at actual 
cost*, and ta make a sensible decision an this 
criterion, we need mare than simple cast figures 
and achievement figures; we need a cast-effec- 
tiveness analysis. Some mainstream programs are 
very expensive* Are these also the mast effec- 
tive? Some pullout progroms are relatively 
inexpensive. Are these the least effective? 
Agoin, it is not easy ta make a policy decision on 
the basis of the IDS findings. 

Con moinstreoming do whatever pullout does 
and do it just as effectively? Here we hove, in 
-essence, the question the IDS set out to investi- 
gate. The results of the IDS ore ambiguous, 
indicating that, perhaps, pullout becomes more 
effective as children get older. But one must be 
very wary of drawing that conclusion even tenta- 
tively* Perhaps the whole thing reverses again by 
grade 5, when children hove acquired oh even 
greater social sense and sense of self-within- 
group. 

If we look at just these four points and assume, 
for the moment, that we hove been able ta 
classify instruct|ona<l situations properly as pullout 
ar mainstream,' we are left with a dilemma- We 
hove on ideological problem; Should we separate 
children and risk damage to self-image? Should 
we ignore potentially powerful methods for 
working with learning disabilities . and keep 
children together? We have on economic problem: 
How can we achieve the, best result at a 
justifiable cost? We hove a scientific problem: 
What OTe the results? How are they related to the 
conditions that produce them? And we hove a 
philosophical curriculum problem: What subjects 
ore most important? Which can' be missed with 
little trauma? 

There is on additional problem of definition. 
How do we identify mainstream classrooms and 
pullout classrooms? Descriptions af all sorts of 
mixed modes emerged in the conference. (See the 
papers by Kennedy-^ and Shuy.) There were 
nrrainstream classrooms in which a special teacher 
coTrie in and the regular teacher left. (Someone 
labeled this situation "p^" There were - 

pullout situations in which the regular teacher 
accompanied her class to a Title I lob where she 
taught tlie regular students and a Title I specialist 
taught the Title I students. There were some 
classes entirely composed of Title I students. 



The main point tq be mode her^s one mode by 
several of our Writers.. The terms "mainstream" 
and "pullout" ore poorly defined and tend to mask 
what are. surely more .important variobles, vari- 
ables which must be defined in areas such as the 
physical quality af classrooms, emotianal quality 
of class gatherings, quality of classroom dis- 
course, quality af peer interaction, mobility, 
stability,, and provision for multicultural experi- 
ence. 

Further, setting moy very well interact with 
other voriobles such as odministrotive or porentol 
support, ond so moinstreoming moy be better for 
one community and pullout better for onother. 
Where teachers favor one setting over the other 
ond work effectively in it, there seems no 
compelling reason— on the bosis of research— to 
force o change. 

Plonninq., Organization, Qnd Monogement of 
Compensatory Instruction 

The IDS undertook on exominotion of highly 
successful compensotory situotions. The teochers* 
comments helped to clorify why these progroms 
were so successful. Reoding the study itself, we 
might hove thought moinstreoming hod the edge 
on pullout OS 0 successful instructionol setting; 
listening to the participants, we were forced to 
believe this ;is not the cose. Something else, 
something more criticol, underlies success in both 
settings. Similarly, time on-tosk is certoinly 
importont, but how is on increase of on-tosk. time 
ophieved? How do teochers, successful teochers, 
keep students hoppy and heolthily tosk oriented? 

The workshops on planning ond orgonizotion 
suggested aspects af successful programs. First, ' 
the conference teachers certoinly met the IDS 
criterion thot only stoble programs be included in 
the study. Most of them hod worked for some time 
in Title I programs and were well ocquointed with 
the oims ond. daily operation of their own systems. 
There was definitely stability, ond, perhops more 
importont,' there Was continuity. 

But there was olso continuous refinement* 
More thon anything else at the 'conference, one 
wos impressed with the resilience and flexibility . 
of the teocher representatives. They molded their 
programs on yearly, monthly, ond daily bases. 

First, they modified state and district objec- 
tives. Although the district might stote its gools 
for Title I children in terms of so mony units of 
progress in reading and math, conference teochers 
wanted hoppy, coring, self-disciplined children, 
voluntory readers, ond competent problem solVers. 
They spoke ogoin Ond ogoin of the importonce of 
self-image, not just in its intuitively obvious 
connection to cognitive growth, but as o humone 
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god important in itMlf. It was door ttxit they 
would have spent time enhancing self-inxige even 
if that goal %vere not connected to cognitive 
growth. Further, they could describe what they 
did to enhance self^imoae. Teochers said that 
some children need to beHfouched Others need t9 
be listened to; they come from large, boisterous 
families and they never get a chance to talk. 
Some kids need to be recognized; they can't get 
needed recognition academically so they wont to 
try to get it some other way. Teochers made 
efforts to recognize talent, even in such things as 
••clowning," when that recognition mode a child's 
day. 

None af this sifKHild be token ta mean that the 
conference teachers leaned toward a Summerhil- 
lion permissiveness with respect to sludies. On 
the contrary, they were deeply concerned about 
academic growth. They adopted a 

teaching/parenting role in which they gave both 
specific instruction ond the kind of cultural 
support we think af as typical in the well- 
educated *^'nr>e. Indeed, in his summary af this 
portion af the conference, David Hawkins 
surmised thot a large portion af the recorded 
success of conference teachers might be due ta 
their "acquaintance with irvdividual children," and 
this possibility deserves study. 

Second, they adopted curricular materials with 
some freedom. It is very hard ta soy how 
scientific ond accurate with respect to subject 
matter these adaptations ore, because we heard 
very little thot wos specific. We heard nothing, 
for exomple, about the detoited use of Cuisenoire 
rods or other moth monipulatives or about specific 
programs for increasing decoding skills or vocabu- 
lary, but we heard about changing, modifying, and 
refining. It seemed that instructional mode was 
changec*most freely. Teact>ers retained materials 
themselves and were grateful for a multiplicity of 
tt)em,'but they sometimes resisted prepockoged 
directions for their use. One teocher, for 
example, spoke of her ••adaptation'* af Project 
Plan, When pressed for the details af her 
odaptation, she said, "Well, mostly I threw it out." 
She hod used the materials, but she constructed 
her own sequence and methods of instruction. 

This is another area requiring serious study. 
Tliese are successful teochers, and they are 
apparently doing something right. There renrniins 
the possibility, however, that they could do some 
things even better with the help of specialists who 
know the materials. One should odd that curricu- 
lum specialists might olso learn something from 
wQtchiy>g the uses to wNch their materials ore put 
in successful classrooms. 

Third, conference tecxrhers showed a high 
degree of social responsivene^ Ond resilience. 



They hod ways of "getting orouncT people and 
situations they found hampering. They wanted 
aides, but they preferred to choose their j)wn. 
They wonted to work with colleagues, but, again, 
they were pleased when working relationships 
could be formed by choice and mutual 
satisfaction. They sow principals in supportive 
roles; a "gooif principol supported his or her 
competent teochers, but the teachers did the 
initiating in instructional matters. 

Shuy notes in his paper that teochers display a 
"two cooks in the kitchen" syndrome when they 
are forced to work together and that perhaps they 
need to learn how to work mare closely in teams. 
But it is possible thot we ore seeing here another 
focet of the science/art aspects of teaching. 
Good teachers wont to plan together, speculate 
over matters together, evaluate together. But 
they wont to perform alone and over the whole 
range of child octivity. They do not wont to be 
assembly line workers. Some teachers even 
enthusiastically endorsed the rwtion of staying 
with children foe several years and this, too, is a 
matter for further study. Surely, what gives o 
teocher great sotisfoction in teaching is likely to 
be correlated with his or her success. 

Fourth, and finally, teachers felt strong 
enough to challenge, theoretically, administrative 
systems of recordkeeping, but they often felt 
frustration in trying to bring about actual changes 
in this area. As both Hawkins and Botel empha- 
size, these teochers feel that they know their 
students. Keeping trock of every bit of progress 
thot children moke ''on little cords" is on arduous 
clericc' task that seems unnecessary. These 
teachers know (intuitively? by ocquointonce?) 
where their students ore, what they need next, 
and what they ore likely to do with assigned tasks. 
The records that a machine must keep, in conr>- 
puter-ossisted instruction, for example, a sensi- 
tive teocher need not keep. The saved time con 
be used in pupil contoct. Again, this is a motter 
requiring a closer look. The recordkeepi.ig may be 
serving a purpose that teachers foil to see. It 
may, for example, induce the teochers to reflect 
upon the effects of their teaching and to plan 
more carefully. Or, p>erhaps, teochers who ore 
free of it do even better. We con only say that 
teochers respond to recordkeeping negatively. 
Most have found shortcuts. 

In summary, it would seem thot successful 
teachers value their autonomy in planning, per- 
forming, and evoluGiir^ They see themselves as 
initiators and place administrators and parents in 
supportive roles. Typically, they spend a lot of 
time (3 or 4 hours doily) in planning. Morking 
popers and recording results ore, ogoin typically, 
less favored tasks. Con something be done to 
enhofKe the sense of artistry in giving feedback to 
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students? Is there a way that teachers could gain 
more satisfoction from the proce» of correcting, 
reassigning^ and refining student work? The task 
requires, perhaps, enhancing the teacher-as-sci- 
entist and suppressing the teacher-os-artist. Is 
there an optimal balance? 

Individualization of Instruction 

The reported findings af the IDS— that individ- 
ualized programs were effective but not neces- 
sarily more effective than other modes— caused 
some initial consternation among conference 
teochers. Many af them just could not believe 
that the enormous effort they put into "individual- 
izing" hod not paid off handsomely. As the 
conference proceeded, these uncomfortable feel- 
ing abated, largely because it became clear that 
the chorocteristics teachers associated with the 
variables— and clearly valued highly— were not 
always the ones researchers had used ta describe 
the variables. 

The IDS used four characteristics to identify 
highly individualized programs: 

(1) Use of bef ivioral objectives 

(2) Individual pacing 

(3) Individual sequencing— interpreted os the 
"existence of alternative learning paths'* 

(4) Use of diagnostic /prescriptive methods 

It is quite cleor that teachers interpreted "pac- 
ing," "sequencing," and "diagnostic/prescriptive" 
very differently from the researchers. 

Stollings describes in some detail how teachers 
looked at "pacing" and "diagnosis." In both cases, 
teachers interpreted the terms much more broadly 
than researchers. Teachers, for exomple, saw 
silent, self-selected reading as a case ipso facto 
of self-pacing and, th'.'refore, a practice to be 
rated positively in a search for individuolizotioru 
Researchers did not look at "self-selected read- 
ing" but concentrated, insteod, on teachers' ef- 
forts to guide or to pace students through a 
predetermined arrangement of subject matter, 
usually a set of hierarchically arranged skills and 
subskills. Similarly, teachers broadened the con- 
cept of diagnosis to include a search for learning 
styles and preferences, emotional needs, and 
social strengths. When these teachers said, "I 
diognose the ctlifrfs problems," they did not mean 
that they p'tn^inttd a child's difficulties with 
respect 1^ t3 portkuilar computotiorKil or decoding 
skill. AInnojtrf suref)y, they engaged in instructional 
diagnosis os^ vm&ll m global diagnosis, but at what 
level of pfofithcncy and with what specific tech- 
niques we really do not know. 



Many teochers, while interpreting particular 
variables and indicators associated with individu- 
alization more broadly than researchers, per- 
ceived individualization itself as working with 
individual students* Both Amarel and Stollings 
note this perception. In cases where teochers 
were not sold on individualized instruction, it was 
often the cose that they rejected' the one-to-one 
instructional mode. As we noted in the section on 
planning, teachers learned that working with 
individuals leaves too many other students 
unsupervised and often unproductive. Stollings 
gives support ta the teachers' intuitive assessment 
of the one-to-one arrangement by citing research 
studies which also conclude that one-to-one is not 
on instructional arrangement highly correlated 
with achievement. 

Here, as in many other complex situations 
under discussion, it must be noted that assessment 
of instructional arrangements across settings may 
be 0 mistake. Amarel points out that there may 
be interactions— among instructional arrange- 
ments, number of instructional personnel, personal 
preferences, student styles, odninistrotive and 
parental support, physical space, and so on. We 
must be careful, then, in stating that one-to-one 
is not an effective instrtctionol mode. If every 
student could receive one-to-one instruction as, 
say, Bertrond Russell did in his childhood, we 
might all opt for tutoring. But under the usual 
Title I circumstances, in which orie teacher must 
work with mcny students whase needs ore great 
and whose self-help techniques are not well 
developed, working with individuals seems to be 
" neither efficient nor effective. 

On the topic of "sequencing," a familiar 
difficulty appeared. Sequencirig was interpreted 
at the conference workshops to mean the exis- 
tence of alternative learning paths. Teachers 
seemed to interpret this variable very broadly. 
Under a broad interpretation, almost every 
teacher could properly claim that she made 
provision for alternate paths to leorning; that is, 
if the learning under discussion is itself broad, 
e.g., "learning to express oneself in a ^ group,'* 
"learning to read silently," the paths available ore 
almost limitless in number. But we heard very 
little about the sort of sequencing that interests 
researchers or those of us engaged in rigorous 
pro^'oms of curriculum design. Do teochers take 
account of various existing yodels of computa- 
tion, such as methods of subtraction? Do they 
attempt to steer some students to one model and 
otl ^' to another on the basis of observed 
per* .mande factors and information about the 
theoretical ossumptior^s underlying the models? 
Are they careful to sequence forms of computa- 
tion occording to information we have about 
inherent difficulty levels, e.g., a . b =o bej^re 
0 • a = c, and a • a = c before a • b = c? Do they 
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depend on preoonstructed curriculum materials 
for this sort of sequencing? Are they cwore of 
what Is known in this^ area? The answers to these 
questions are by no means cleor. At the global 
level, teochers are keenly cwore of individual 
differences and preferences end seem to be 
constantly modifying, trying out, adding, and 
deleting both materiols and methods. At the 
specific level, we need more information obout 
teocher proficiency. 



Throughout the discussions on individual izo- 
tion, it was clear that these teochers used their 
judgment freely yet responsibly. In deciding 
which children were entitled to Title I instruction, 
they used the required tests but felt free to add or 
delete students from the list (more free to odd, 
interestingly, than to delete). In choosing modes 
of instruction, they exercised their judgment to 
accept, reject, or nrx)dify instructions that 
occompony pockoged materials, An<j they volued 
highly opportunities to use their judgment in such 
matters as hiring aides, choosing texts ond tests, 
allocoting time, and choosing colleagues with 
whom to cooperote. Indeod, many of the exom- 
ples of f rustrotion or discontent that w*^ re men- 
tioned involved perceived infringements on their 
right to exercise professional judgment. 



Finolly, in connection with the generol topic of 
individuolizotion, it is interesting to note that ot 
least two of our outhors (Amorel ond fHcwkins) 
urge caution in evaluating methods cind modes 
where o foulty "more the better" hypothesis nxjy 
oe operoting implicitly, hkiwkins uses o medico! 
onojogy to describe o situation in which a needed 
treatment, overdone, becomes o destructive cous- 
a) agent, and Amarel emphasizes the possibility of 
curvilineor relationships as the realities behind 
assumed lineor descriptions. It is entirely 
possible, they suggest, that a particulor 
instructional strategy might be highly effective 
used for, say, IQ-minute periods and demonstrably 
destructive used for 30-minute spans. 



We ore left with the impression that the 
scientific portion of the IDS has told us what not 
to count on for results in achievement, and this is 
helpful. The teochers, for their port, hove told us 
w^ot we may be able to count on, but we cannot 
yet transform this information into prescriptions. 
Perhaps the wisest course for a policymaker is not 
to try to prescribe exactly or narrowly what form 
.instruction should take but to support responsible 
experimentation, continuous and duoJ evaluation 
of the sort attempted by NIE in the IDS, ond 



openness in the dialogue between teachers and 
researchers. 

Summary 

As the IDS itself yielded important informa- 
tion about teaching as science, the IDS 
Conference filled out that picture with a glimpse 
pf teaching as ort ond profession. Reseorchers 
approach teaching situotions indirectly and ono- 
lyticolly through the mediation of variobles and 
hypotheses. Teochers opprorjch teaching directly 
and intuitively. It has long been recognized that 
researchers can contribute information useful for 
teochers. Now we see that teachers can make o 
contribution toword more significant research. 

Their discussion suggests that it might be 
worth concentrated research effort to get .nore 
information in the following areas: 

(1) Curriculum materiols— How teachers use, 
odopt, and refine them; whether teachers 
understond their potentiols; haw fovored 
instructional modes influence the choice of 
moteriols 

(2) Instructional nrK)des— How these ore 
matched to student needs and curriculum 
potterns; how mcny distinct modes o suc- 
cessful teacher uses effectively; under 
what conditions various nrK>des are 
effective 

(3) Teocher flexibility — How teochers odapt to 
vorying needs in their students? use of 
vorious rrK)des in instructional discourse; 
odapt ot ion ond refinement of objectives os 
well as moteriols 

M Enhancement of self-image as an 
educational goal — Can it be shown that 
children reolly do feel better about them- 
selves—and with some reason— when they 
hove worked with teachers who ploce self- 
imoge high on their list of educotional 
goals? What do teochers do to enhance 
self-inrKige? How often are the techniques 
that conference teachers reported using 
octuolly used by other teochers? 

Teachers and reseorchers both profit from the 
sort 6f dialogue initioted by NIE. But policy- 
makers olso profit. The information teachers 
contribute tends to soften research results and to 
coution policymakers about simple solutions. The 
conference teachers urge us to look beneath ond 
beyond quontitotive findings for the qualities that 
moke o difference in effective teoching. A 
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conference of IhU sort points up, rather drom- high orders of toferonce for ambiguity and of 
otically, thot there is no "royal road" to the critical thinking skills are required of teachers, 
understanding of educational problems. Rother, re s earchers, and policymakers alike. 
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Chapter m. Educational Opportunity 



OPPORTlt iSTY TO LEARN 



Goeo Leinhardt 
Learning Research and Development Center 



The charge for this paper was to integrate the 
comments of teachers with the research literature 
in the area of opportunity to leam. Of the 700 
teochers who participated in the Instructionol 
Dinnensions Study (IDS) 0<irschner Associates, 
Inc., 1977), 40 gathered at a conference to discuss 
the results of that study. This paper attempts to 
weave the ideas and concerns voiced by 40 
teachers and specialists over a 2-day period with 
the ideas and concerns voiced by researchers over 
the last 10 to 15 years. If there ap()ears to be on 
imbalance in the presentation, it is due in part to 
on imbalance in the availability and form of the 
information. The poper Is not a complete review 
of the literature in the area. Rather, I have tried 
to treat the nruijor themes extant in the literature 
OS a backdrop for the dialogue between the study 
findings and the teachers. 

This review focuses on the concept of educo- 
tibnal opportunity at the classroom level. 
Ex6lT)ination of educational opportunity at the 
system and school level has been the focus of a 
consideroble amount of previous effort (ColenrHXi 
et ol., 19^ Jencks et at., 1972). Although the 
specific variobles of concern ore very different, 
thrMt^t-b simtkir. Opportunity is the chance of 
obtaining, or the' access one has to, a -valued 
resource. It is essentially on ecrooomic and 
politicol concept as opposed to a psychological or 
sociological one. In education, the resource of 
interest Is knowledge. The more conrvnoiily 
described or measured resource is formal educa- 
tion, access to which presumably leads to knowl- 
edge. 

The construct of opportunity con cover a wide 
range of concepts* from physical focilities to 
faculty credentials to student learning behaviors. 
How opportunity is rheasured in any one situation 
tends to define It. In the IDS, opportunity was one 
-of four Instructional constructs thought to affect 
learning outcomes; ttie ottier three were nriotivo- 
torSf inetnictionol events, and curriculor structure 
(Cooley and Leinhardt, 1975a, 1975b, 1978). 
Opportunity .wos operationally defined by two 
variobless the amount of time available for 



reading and math instruction, and the impact of 
exposure to criterion relevant instruction. 
Time 

It is important to remember that the pqssoge 
of time itself does not affect learning directly. It 
is only the time spent in doing something that is 
relevant. Tirfie is a convenient metric of 
sequence and duration. The degree of conven- 
ience varies >yith the perspective of the viewer. 
To the degree/ that we can easily express paranrv- 
eters of instruction and leoming by it, it is a very 
useful tool. It is the power of tinne to inform with 
respect to sequence ttxit permits us to infer cause 
and effect. / 
/ 

In the IDS, time was measured in two different 
ways: (q^ jrhe quantity, in minutes, of supple- 
mental instruction given to a student; and Q>) the 
combination of: the number of days between fall 
and spring testing, the time scheduled for reading 
and maTn,|attendance rotes, and the percentage of 
students or^^tosk, while large class size and a high 
turnover/] of students were considered to be 
detractors from tinr>e. When it is reported that 
..time wds: positively related to achievement, it 
means that both of these basic representations of 
time were positively related to ochievennent. 

Researchers in education hove found it useful 
when describing the time available to students to 
distinguish between different levels of time 
^meosurement. When describing the time available 
for subject matter, researchers tend to distinguish 
between allocated and engaged time and between 
the amount of tinr>e given as opposed to the 
annount needed (Anderson, 1973; Berliner, 1976, 
1977; Berliner and Rosenshine, 1976; Carroll, 
1963). 

Allocated Vime refers to the assignment of 
blocks of time to a given subject nrxitter area at 
the district, school, or grode level; it is not a 
reflection of how much time o student needs or 
spends doing the subject. In general, allocated 
time is considered to be the upper boundary for 
engaged time. 
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Engogbd time refers to the amount of time a 
teacher and the clou actually spend In the subject 
areo-*-al located time minus manogement Instruc- 
tions and disruptions. Engaged time con be 
further refined to Include only the cmount of time 
o student spends working on **oppropriate" learning 
material (Berliner, 1976; Arlln and Roth, 1978). 

Before we go further, lest it sound as if 
researchers are systematic and precise with 
respect to the Issues of time, It should be noted 
that the research definitions tend 5o slide bock 
and forth between or>e type and cnother with 
great ease. Researchers tend to mec!8«.?re time c?n 
the most economical way they coiv while still 
answering the question of Interest. Thus, Wiley 
43nd Homlschfeger (1975) and Husen (1972) began 
wilh such broad measures as ttie number of (^s 
of attendance and have moved to estimates af 
actubl instructional time (Harnlsc^feger and 
Wiley, 1977). Bloom and his students have tended 
to measure time onntosk and found positive 
relationships where allocation and currlo'lum 
content were fixed (Bloom, 1976; Block, 1970). 

Many large-scale studies, the IDS Included, 
focus primarily on allocated time (Stallings, !975; 
Beginning Teocher Evaluation Study [BTE^976- 
77; Kirschner Associates, Inc., 1977) because it is 
very costly and difficult ta get more refined 
estimates. Often, as In the IDS, there is an 
attempt ta modify the simple estimote of allo- 
cated time by taking into account the attendance 
,of children, time on-tosk, etc. Studies investi- 
gating the relationship between allocated time 
only and achievement have rarely shown signifi- 
cant relationships between the two (Rosenshine, 
1978; Stallings, 1975). Per example, at the class- 
room level, very low correlations between minutes 
per week in o subject and gain (-.04 and .12) were ' 
found in the IDS. This is consistent with ether 
work (Rosenshine, 1978), Wiley and Harnischfeger 
(1974) did find significant relationships between 
allocated tiine'and achievement, but these were 
not replicated by Korweit (1976) In her reonolysis 
of the dato-nor were they replicated by the IDS 
(Kirschner Associates, Inc., |977). 

At the IDS Conference, teachers consistently 
referred to ollocoted time as a fixed entity. If 
allocated time is indeed fixed at the school or 
district level, then any Individual variation in 
teacher practices (with respect to the organiza- 
tion of time) would tend to be ignored by on 
estimate of time thoe considered only allocation.' 



For 0 fuller discussion of the implications of 
alternative modes of education, see Kohlberg and 
Mayer (1972). 



More flne-grolned estimates of tirne spent In 
Instruction tend to result In stronger relationships 
with achievement (Anderson, I973y Bloom, 1976; 
Fisher et ol., 1977; Felsenthol and KIrsch, 1978; 
Welch and Bridgham, 1968). These estimates, 
unlike allocated time, discriminate among those 
teachers who ore efficient managers an<j pionr^ers 
and those who ore less efficient. Thus, two 
teachers working under similar allocations oi time 
can, and probably do, differ In the amount of time 
their students ore engaged In learning. The line 
between engaged and allocated time is not always 
clear in qctuol research (Morllave et ol., 1977; 
Filby et ol., 1977; Wiley and Harnischfeger, 1975). 
As methods of describing allocation get nnore and 
more precise, for example, allocation of time to 
place value, or compound words (Morllave et ol., 
1977), allocated tinr>e begins to look, from a 
descriptive sense, more like engaged time. The 
mo^DT difference, however, lies with the student. 
Estimates of allocated time tend to be free of 
student information. Estinrrates of engaged ilme 
tend to include student behcviors. As estimates 
get more precise and include student information, 
the relationship to achievement gets stronger. 



In the descriptions of the specific activities 
students engage in during the language arts or 
reoding period, it appears that considerdble time 
is spent in nonreading behaviors. That is not to 
soy that these activities are unimoortont or not 
valuable, only that they ore not reading. For most 
classes, the amount of time really spent in the 
subject area can probd>ly be approximated by 
allocated time minus off- task times a fraction. 
This fraction has as a numerator the number of 
odults and as a denominator the number of groups. 
For example, assume 100 minutes of allocated 
time minus 10% off-task, leaving 90 minutes; 
assume five reading groups with two adults; the 
fraction is 2/5 times 90, or 36_ minutes. The 
assumption is that nruxrh, if hot all, teocher-led 
time is ocodemicolly focused while the. majority 
of the remainder is not academically focused. It 
may be the case that higher amounts of tinrie can 
be recorded, but it isn't clear what the children 
ore doing during those times. There is olnwst 
always a discrepancy between teochers and 
researchers when estimating engaged or on-tosk 
time. Teachers consistently rq>ort a higher 
estimate of engaged time (80-90%) while 
researchers report a lower estimate (50-70%) 
(Good and Beckermon, 1978; Powell and Cohan, 
1977; BTES, 1976-77). This may be beiJouse of 
differing definitions, or perspectives, or one group 
may be correct. The point is that when 
researchers estimate engaged time, that estimate 
is related to ochievement. I hove not found ony 
study in which the teacher's estimate of engage-: 
ment was used as a predictor. 
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Another way to view the problem rs to 
consider what part of subject matter time Is 
clearly nonreodlng or nonnrKith. It seems from 
teacher descriptions that there wos between 20 
and kO minutes of nonreoding me per ^^our. That 
time is spent in a lot of things: cutting and 
pasting, group discussion under the rubric of 
language development, or some type of group 
activity, such as preparation for a newspaper or a 
play which has. o strong reeding or writing 
component in it, but in which the number of 
minutes children are really reading is very small. 

At the IDS Conference, teachers identified 
another source of reading time, content areas. 
Some teachers reported that actual reading time 
could be increased or reinforced through the 
content areas, rather than replacing content areas 
with expanded reading periods. The tradeoff, 
then, is between reading taking up larger amounts 
of time and increasing the time spent in those 
subjects that have o high reading component. By 
increasing content area reading, it is possible to 
increase the amount of engaged reading tiiiie 
above the level of allocated reading time. From 
an economic perspective, the opportunity cost of 
increasing allocated reading time above Ife hours 
a day seems to be quite high, but the opportunity 
cost of increasing engaged reoding time is not as 
high if one is willing to count reading thut goes on 
in subject matter areas. This would not be as 
effective in mathematics, although science and 
parts of social studies con certainly reinforce 
early orithmetic ski lb. 



Teachers mentior>ed some factors that tend^to 
reduce instructional time such as: testing, indi- 
vidualization, . physical movement, organizing 
large numbers of students, program or activity 
nrxmagement, and discipline. In some districts, 
the formal testing load was incredible, covering as 
much as 3 weeks in the foil and spring. This con 
be reduced by coordinating Federal, state, and 
local testing requirements and keeping them to a 
minimum, individualization, or independent work 
by children at different levels of study, was seen 
as reducing on-task behavior. It wos clear that 
managing children who were working indepen- 
dently created some difficulty. One presumes 
that with on appropriate management procedure 
in ploce, this could be overcome (Wang, 1976). 
Moving students from one port of o building to 
another takes considerable time, but often is 
physically and economically impossible to avoid. 
It appears that movement is facilitated when 
adults accompany children and when the routines, 
ore well esta^ilished and consistently imple- 
mented. The general oreo of discipline and 
program morKsgement came up as o problem 
HDoinly in coses where: (o) the supplemental 
programs involved handling large numbers of 



students simultaneously; (b) the program 
arrangements were being changed frequently; and 
(c) the links between regular teachers and supple- 
mental teachers were not formally maintained by 
such activities as planning o student's program. In 
general, within-class discipline was not mentioned 
by teachers (although it frequently is in the 
popular press) as o major problem or source of 
time owoy from Instnjclion. 

An alternative way to increase "productivity" 
is to increase the rote, or pace, with which 
material is covered within a given period of time. 
Researchers hove generally assumed that pocing is 
o function of student neods (Anderson, 1 973^v 
Bloom, 1974) and that smarter children ore raster. 
However, recent research and common sense 
indicate high wi thin- pupil variation on time to 
criterion (Glosnopp et al., 1978). A student may 
be fast at some things and slow at others within o 
single academic area, such as moth. In general, 
teachers did not feel it was very desirable to step 
up the pace of learning. Several teachers felt 
that increasing pace would decrease mastery; 
however, this has not been supported by research 
litsroture (Barr, 1973-74). Teachers seemed more 
concerned with finding the appropriate pace 
rather than in speeding It up. The question of who 
should decide the optimum pace was discussed by 
the teachers. In general, teachers feel that they 
should set the pace of ia^>truction. Most teachers 
seemed to feel that students would not pace 
themselves appropriately if left totally alone. In 
individualized or port'illy individualized programs 
where students share pacing responsibility with 
teachers, it was felt that teacher guidance was 
definitely needed. DahDof (1971) has suggested 
that teachers tend to set level and pace at -the 
bottom 25% of the clac^s.^ When this is considered 
with Bqrr's (1973-74) finding that slowing the pace 
for the poorer children did not help them and 
speeding it up didn't hurt, them, it may be that 
teachers, too, need some guicbnce on pacing. 

Timing . In addition to learning about how 
much time is spent in a given area, researchers 
and teachers ore interested in the arrangement of 
time, or timing (Korweit, 1977). Do students 
learn nrwre from a solid block of instnJction or 
more from several shorter blocks. (Karweit, 1977; 
Rosenshine, 1978)? Is it important when instruc- 
tion occurs within the year, the week, or the day? 
In general, the literature tends to reflect the view 
that continuous instruction is "better." 
/ . 

Continuous instruction means uninterrupted 
blocks of time within o day, doily presentation of 
material, ond continuous 8- or 9-month school 
years. These features minimize tool-up and tool- 
down times. But as Karweit (l977)*points out, * 
there is a tradeoff between the tool-up costs and 
the costs of boredom. Some researchers feel that 
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o I hterruptions are to be minimized and thot, 
given the very low et timofca of time spent in 
subject areas, there is considerofcle leeway before 
it'^f 9et bored (Rosenshine, 1978). Little 
distinction is drown between plamed interruptions 
and unexpected disruptions, olthough the latter is 
probobly more detrimental than the former 
IKounin and Gunr», 1974; Kounin and Doyle, 1975: 
Karwelt, 1977). Teachers seemed to hove o more 
»Jbtle conception of arrongement of time. They 
d^ribed c base core of uninterrupted time to 
which odditlonal time could be odded around it 
(long/short/short or short/long/short). One 
teocher reported using two large blocks of time— 
o.m. ond p.m. (long/long)-in which different 
instructional ^^rooches for thie some content 
were used (linguistic in the a.m. and whole word 
in the p.m.). 

Another blocic of time to be considered is the 
school year and the possibility of rearranging it. 
The current arrongement consists of approxi* 
motely 36 weeks of school with two' or three 
major breaks. Other arrangements are clearly 
possible. The advantages to alternative arrange- 
ments seem to be less educationol than social and 
economicoL Some teachers were In^i^rested In 
considering arrangements which took the summer 
vocation btock and distributed it throughout the 
school year, but most teachers felt that the tool- 
up time required at the end of a long holiday was 
such that you wouldn't wont to do that more than 
once, and that children need a sustained break just 
OS they need sustained instruction. 

in summary, time is on important constrtict for 
research on edxrotion. However, we still know 
surprisingly little about it. Teochers and 
researchers need to develop a conrvnon and precise 
vocobulory that reflects quite closely the 
instructional content. Terms such as **language 
arts" ore intentionally global and vogue, and while 
tfiey hove.the feature of integrating rhe many 
attributes of language usage, they tend to mosk 
for both teochers and researchers how time is 
spent in the subcomponeriX^. If labeling, becomes 
more precise, then the/mejsurement of time can 
follow. (This should not, however, be interpreted 
as support for a highly fragmented analytic 
approach to the teaching of reading.) In formu- 
lating recommendations, researchers must be very 
sensitive to the opportunity costs ^or teachers and 
students that ore associated witi jncreasir^ allo- 
cations of time in one or another areas. The 
opportunity costs In time clearly ore nof linear. 
Thus, the first lO-minute increment of moth time 
costs less ,<than the seventh Increment (see 
Karweit, 1977; Wolberg, 1977). In considering 
researchers' recommendations, teachers need to 
be sensitive to their own limitations in estimating 
student time in learning activities, as opposed to 
teacher time spent teaching (Marliove et ol., 

1977). ^ 



Activity Structures . Activity structures ore a 
way of examining the life of a student In a 
schoolday (Kbunln and Gump, 1974; Kounin and 
Doyle, 1975; Bosscrt, 1978; Westbury, 1978). It Is 
a relatively old and recently renewed sociological 
concept. Activity structures examine the exper- 
ience sequerxres of students (or other actors) 
throughout fme day and label blocks of eentiguous 
time not by the cognitive information, but by the 
activities or actions in which the child is actually 
engaged^ 

There are two major contributions that the 
concept^ of activity structures makes. First, it 
points up the vast variety of actions in which the 
actors ?n a school engage. Individuals who are not 
frequently inside the schools have only the 
dimmest of notions of what goes on in them. 
Second, the concept aids in keeping .straight the 
many perspectives of the actors In d school. Time 
spent in mathematics has very different meanings 

/when 0 researcher clocks a sTudent or a teacher. 
In foct, that very distinction may resolve much of 
the problem associated with estimating time. 
Activity structures serve a useful descriptive and 

definitional function. 

The notion of activity slructuros must be kf;pt 
in perspective, however. As Doyie (1978) points 
out, the notion of activity structures is useful and 
fascinating if what one wants to do is describe 
internal relationships of elements of schooling. 
Doyle also points out that activities ore very 
important to teachers and form d core for 
planning. If, however, one wonts to draw causal 
relationships between instructiorKil procedures and 
student learning, then the notion of a task is 
probably nIOre useful. Tasks con be viewed as 
having goals and mechanisms for meeting the 
goals (Doyle, 1978). In the IDS, the object was to 
identify the drn>ensions of instruction that affect 
ochi^veynent, not to describe the total 
instructional environment. The limitation to the 
task qpprodch is that important causal events nrxiy 
be missed by the researchers' definitions— the 
limitation of the activities approach is data 
' swamp. 

Overlap 

' ' The second major variable within . the oppor- 
tunit)- construct is overlap. Overlap refers to on 
estimate of the degree to which the curriculum 
teaches the material assessed by the criterion 
measure (test). OverlqpMs o port of the opportun- 
ity construct because it represents the chance the^ 
student hod to be exposed to criterion-relevant 
material. Overlap does not estimate how much of 
what was tought was tested, only how much of 
what was tested was taught. It is important to 
include infornrHition on overlc^ in any study of 
instrucrional impact because students could hove 
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a very ''goocT educational program and spend 
considerdble time on it, but there nnight be little 
criterion-relevant (test-relevant) instruction in 
the program. 

An estimate of overlop con be used in ^three 
ways: (a) it can be used to "adjust" the criterion 
measure by deleting all items not taught !n\the 
curriculum; (b) it con be used to stratify 
classrooms or only consider comparisons of 
instructional technique among classrooms with thie 
same (or similar) level of overlap; and (c) it con be 
used as one of the variables in on analysis such as 
regression. In the IDS, the third option was 
chosen because options (a> and (b) mode it 
impossible to compare programs simultaneously. 

The question ' of how to measure overlap is 
somewhat complex. As with time, the specific 
procedure for measuring overlap will affect how 
one should interpret the results. There ore two 
basic approaches to estimating overlap. The first 
is to label either the subtests or subcategories of 
the test(s) and estimate both the presence and 
emphasis of these categories in the curriculum. In 
some cases, this is done by including information 
about student end-of-year location (Kugle and 
Calkins, \976); in others, it is the overall 
.curriculum that is compared (Armbruster et ol., 
1977). When general overlap estimates ore 
correlated with other curricula and ochievement 
gains, o significant positive relationship is found 
for reading comprehension (Armbruster et ol., 
1977). Thus, to the degree that a reading text 
emphasizes the some areas of reading as the test, / 
the students will perform better. 

The second approach is to define what is 
needed in order to pass each item on the criterion 
measure, then to search the curriculum to see if 
and where the .information is taught. This type of 
analysis is dpne at the student level (Cooley and 
Leinhardt, 1975a, 1978; Poynor, 1977a, 1977b), 
and it is more fine-grained and precise than other 
approaches, to measuring opportunity. 

The IDS finding was that there was a high 
positive relationship between overlap and test 
performance. This finding is especially important 
because of its consei^ative nature. It was 
assumed in constructing the measure that children 
had the capability of generalizing and that that 
would reduce the power of the overlap measure. 
That is, children would be able to get items 
correct to which they had not necessarily been 
directly exposed. While that is Undoubtedly true, 
the probability that the student will get the items 
correct >seems to be sgl^stantially higher if the 
student-hos been exposed to the specific material 
in that item, and thot is what's important. 

In the IDS, overlop was measured by creating a 
dictionary of the Comprehensive Tests of Basic 



Skills (CTBS) (CTB/McGrow-Hill, 1973-74). Then 
o dictionary of all the major curricula being used 
in oil of the regular and supplemental classrooms 
was nrKKJe (Poynor, 1977a). The location of each 
student at the erxl of the year In that curriculum 
was monitored, and the cumulation of all the 
curriculor information was mapped onto the 
specific test information. For each item on the 
CTBS, it was necessary to determine if the 
student hod been exposed to material that would 
permit him or her to get the item correct. 
Specific rules were generated. For example, if on 
addition problem was encountered on the CTBS, 
then the student must hove hod either those 
specific numerals or numerals higher in value than 
those numerals. Thus, if a student hod been 
exposed to 8 and 9 in addition problems, and the 
problem was 6 and 5, then the overlqp was a 
positive one. For the reading items, on analysis 
was done to determine which words a student 
needed to know in order to answer the test items. 
The number of words was generally less than the 
number of words that were in the specific item, 
and both the stimulus ^nd response words hod to 
have been taught at some ploce in the curriculum. 
The mossiveness of this task con only be 
appreciated when one reolizes that each student is 
actually exposed to multiple curricula, quite 
frequently in each of the subject matter areas, 
reading and moth. 

When presented with the IDS findings, teachers 
agreed that children would do better when tested 
on material that they knew and had been taught. 
However, the Teachers tended to expect students 
to be ab!e to perform on tests that require the 
student to generalize to a greater extent than the 
IDS finding implies. Teachers felt that item form 
was quite important in predicting how teqsily a 
stt lent could respond to a given problem. For 
example, if a student hod never been .exposed to 
horizontal addition, it was unlikely the student 
would read the question correctly and respond 
correctly, even if he or she hod been exposed to 
vertical addition. In general, they reported 
teaching children the format, although not the 
content, of testing prior to the test. 

Testing . Teachers used the discussion of 
overlap to go into considerable/detail about their 
attitudes toward testing. The discussion revolved 
around three aspects^ of testing: (a) teachers' 
attitudes toward storidordized, nationally normed 
tests, (b) teachers' attitudes toward nonstandard-, 
ized criterion- or domain-referenced tests, and (c) 
teachers' views of a national testing program. 

Teachers responded favordbly to standardized 
testing programs if they (or their representatives) 
had been involved in selecting the test. It was 
especially important that the test reflect the 
nrKijor curriculor objectives of the statewide cur- 
riculum being used. Teachers agreed, when 
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pressed^ thot testing gave them iMful infomKH 
tioTu For exortplet they felt tests provided on 
occurote assessment of v/ho should be eligible for 
Title I services. For the most parti the tests 
separated the top-performing children from the 
low-performing children. Teachers did not object 
to.the norming process itself, and they felt it was 
rea onoble to know how their children were doing 
in : elationship to otfier children in the Statei 
• district, and country. 

However, tests con be and frequently are 
abused. Often there were serious problems 
reported with overtesting. There were sonrie coses 
where tests seemed to be inappropriately used to 
judge programs and children. Teachers felt that 
standardized testing is difficult for children in 
their early years, and it is specifically difficult 
for Title 1-eligible compensatory education stu- 
dents. Teachers also felt that no standardized 
test ever gave them information at the student 
level that could be used for teaching purposes. 

A major alternative to standardized testing 
that is being used in some school districts is 
criterion- or domoin-referenced tests. Teachers 
described several scenarios in which criterion- 
based tests were effectively used. 6ne mode is to 
test students according to o time schedule, min- 
imally at the end of every year, moxinrxilly every 
3 or 4 months. Another approach is to request a 
test whenever a student or d group of students is 
ready for a specific concept to be tested. Some 
districts have developed a testing bank for indi- 
vidual objectives that hod been agreed upon by 
both the teachers and the district-level personnel. 
Criterion-based testing was perceived as being 
just OS bod OS' standardized testing tf it was 
externally laid on. It is only superior in the eyes 
of teachers when it is used with teocher input and ' 
remains flexible with the option of teachers 
revising it. 

Criterion-based testing tends to be helpful in 
diagnosing individual student needs. This may be 
because the terminology used in 'the tests and the 
item forms ore very similar to what the teachers 
ore teaching. It seenned to be on assumed 
characteristic of criterion-based tests that they 
were manipulative as opposed to multiple choice. 

Many researchers shore teachers' concerns and 
misgivings about testing. Several elements seem 
to be relevant to this problem. Tests ore very 
easy, esoeciolly standardized tests, and they tend 
to reflect only the superficial elements of knowl- 
edge. They ore easy to give, to score, and, in 
some ways* at least, to Interpret. Highly 
structured ond focused instruction yields impres- 
sive gains on highly structured and focused tests. 
But questions on whether these techniques retain 
their impoct in wore complex examinations of 



knowledge rem^^A unanswered because the more 
subtle aid complex elements In knowledge acqui- 
sition remain unmeasured. While nruviy teochers 
and researchers (Doyle, 1978) believe that tightly 
structured instruction will foil to be ds important 
, wheri brooder knowledge is measured, their view, 
for now at leost, renrKiins speculative. 

A final .<«erendipitous point which ennerged 
from the disc^wsion was the cc/icept of a national 
testing program. Researchers and politicians hove 
tended to bock away from the whole aspect of 
nationally boser^ testing, especially in the area of 
basic skills. Teachers, however, were very open 
and more receptive to that concept than would 
hove been expected. Teachers thought that o 
notional testing program could be developed if it 
were done in strands (maybe of objectives), if 
representative teachers were deeply involved in 
the construction, and if the test was manipulative 
as opposed to multiple choice. They see 
considerable utility in having o notional test, in 
port because it could help reduce the overall 
testing load. 

Teachers were sensitive to the concept of 
appropriate criteria. This come out of discussions 
of some findings that were somewhat inconsistent 
with what the teachers expected. They pointed 
out that researchers tend to measure things that 
ore easily measurable. For example, they felt 
that it was not reasonable lo dismiss the concept 
of class size as being unimportant if no impact on 
oChievenrtent was found because the appropriate 
criterion for the impact of class size may not tie 
achievement, but might be student and teacher 
emotional state or quality of life. However, they 
did admit that it would be for more powerful if 
something like class size could be shown to hove 
detrimentol effects on achievement; 

Conclusions 

The opportunity to leorn is o voluoble way of 
.'considering educational resources and is o useful 
h'wristic for studying effective instructional fee-, 
tures. It is important, however, to reglize that 
opportunity is o^ly one dimension and that other 
areas, such as the quality of v instruction, ore also 
worth investigating. Research results indicate 
^ that when opportunity is carefully defined in 
terms of time spent working on criterion-relevdht 
material o<t <;riterion overlap, then there is o 
strong relotrlpnship between it and achievement. 

Opportunity should probably be limited to 
mean' the quontity of time available or used and 
quantity of criterion-relevant instruction. While 
considerable research hos been done in the area of 
time spent in specific I eording activities, more 
precise knowledge is need^d^dbout the cost and 
differential impoct of spending time in different 
subjects at different grod^' levels. We need to 



•<naw, for example. If 10% increments In moth It? Most people seem to believe that tlie 

tfme will show more influence qt 2d grade than significonce of curriculum overlap diminishes as 

5th grade, or more or less than an equivalent tte criterion .gets more complex and as children 

increase in reoding* Teachers and researchers get older — but where end '^en does this occur? 

seem to believe intuitively in a point of dimin- We will need both clinical and resebrch-based 

ishing returns for increases in time, but where is information to onswer these questions. 
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OPPORTUNfTY TO LEARN: 
ANOTHER CASE OF THE RESEARCH 
TALE WAGGING THE DOG 
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At first glance, the new research interest in 
"opportunity to leam^ and "engaged tinne" would 
seem ta herald an advance in ^ methodology arid 
conceptualization of educational evaluation. The 
results of evaluation studies, such as the IDS, can 
be better understood if we have detoiled informo- 
tion d>out the learning environment whose Tmpact 
h being assessed. In this regard, the need to 
Hiescribe and measure opportunity to learn-*the 
"extent to which a child has actually been available 
and/or r:eceptive to the influence of his learning 
envirormnent*— is fundamental. However, the 
ambiguous nature of the definitions and interpre- 
tations of these new constructs raises questions 
obout their usefulness. This paper examines sorne 
of these problems of definition and data interpret 
ration, and olso considers the circularity and self-^ 
fulf Hling quality of research thus far stimulated* 

The Problems of Definition and Measuren>ent 

In measuring opportunity to learp and engaged 
tInrKf, the educational reseorcher attempts .to 
gouge the degree to %vhlch a child has octualty hod 
the opportunity to be influenced by the program 
whose impact is being evaluated. Such data con 
help to Illuminate evaluation findings. If posttest 
results fall to show evidence of achievement test 
gains, how are these negative findings to be 
explained? Are the results attributable to a 
failure to implement the program property or to 
the program's intrinsic limitotions? If positive 
results are obtained, which aspects are mainly 
responsible for its success? Without detailed 
informotion regarding the transactions that take 
place in an educational program, it is almost 
impossibl^^to account for its success or failure. 

Efforts to study opportunity to learn and 
engaged time ore directed at understanding the 
role of one aspect of the <antecedent conditions In 
•on evaluation study-^the (fiegree to which chilcfren 
ore "^tuned InT or octively participating in the 
work life of the clossroonn. The basic design of 

studies of opportunity to learn arxJ engaged time 
coils for examining fho 'correlation between meas- 
ures of these varid>les or^ gains in achievement 
test scores* Such corr^lotton data indicate the 



degree to which measures of opportunity to learn 
are predictive of educational achievement.} 

In pursuing this line of research, investigotor:: 
terxi to use different measures of opportunit/ to 
learn interchangeably. If it is established thot o 
child (a) was absenfjnuch of the time, or (b) was 
seldom actively engaged in the work that was 
assigned, or (c) was not exposed to the' nrraterial 
that was contained in the posttest measure of 
achievement, we may be helped to occount for 
some of t.ie results of on evaluation study. Tne 
first example focuses on whether or not the child 
actually attends class. The second deals with the 
degree to which the child is psychologicolly 
related to the events of the classroom aivl the 
learning situation. Tlie third reflects a more 
functional analysis of the^lM-'oblem: instead of 
dealing with tfie child's pqQem of reaction to the 
classroom, it asks whether he was exposed to the 
material included in the achievement test, 
whether he hod on opporlpnity to learn what was 
being used as on ihdeoc of progress. Two of the 
antecedents ore concerned with characteristics of 
the student, with his physicol and psychologicol 
presence; the third cfeob with characteristics of 
the teaching situation, with wfiot the child has 
been exposed to in class. 

The first, physical presence, would q>pear to 
be a necessary condition for school inf luc^hce but 
hardly a sufficient one. It is on attribute that is 
easily and precisely measured. A child's 
"engogedness'* in the classroom is much more 
difficult to define ond measure. Engaged time is 
sonrwtinDes measured directly by observation and 
nrxxiitoring of classroom interaction ond som^ 
times retrospectively by tallying the number of 
pages read or workbook assignments completed. 
Both kinds of indices present problems. Those 
based on direct observation of the child must 
define and measure erigogedness in children, and 
definitions nrxiy differ. To the troditional educe- 
tor, o child who is block building is not engaged in 
learning. Others moy question whether the child 
v4\o is rltuolisticolly copying words or numbers 
from a workbook Is octuolly engaged in learning 
activities. As to those indices of engogedness 
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that are based on the chilcfs previous output, they 
may reflect ability level reather thon engogediess. 

Efforts to determine the degree of corribpon* 
^ dence between exposure to particular content and 
.performance on achievement tests present both 
conceptual and methodological problems.' The. 
correlation between posttest scores and exposure 
to test-reldted content in the classroom reveals 
more about the strengths and wedkntsses of 
achievement testing than it does about the influ- 
«!gc^f. opportunity to learn on achievenient 
gains; ^ addition to being difficult to interpret, 
such data are marred, by the procedures used to 
measure exposure to test-relevant content- 
teachers' retrospective judgments of whether the 
test material hoid been previously covered* 

Despite the fact that these vario^ antecedent 
nneasures assess different factors, present varying 
limitations and deficiencies of measurement, and 
generate data that are difficult to interpret, the 
resuHs of research in this area have been cited as 
though they are a homogeneous, uncomplicated 
mass that has unmistakable implications for edu- 
cational policy (see Rosenshine, 1978). 

The Methodological Premise: Commitment to 
Evaluation by Means of Achievement Testing 

Research in opportunity to learn accepts the 
basic methodological premise of most evaluation 
studies— that achievement tests provide valid 
measures of educational progress. This new work 
obscures longstanding perceived deficiencies in 
the methodology of evaluation. Educational 
evaluation has been subjected to two major lines 
of criticism: (I) achievement tests are regarded 
as invalid instruments of edxrationol evaluation 
because they ore only marginally related to many 
educators' hierarchy of educational objectives, 
and (2) methods of educational evaluation fail to 
identify the elements of the .^dOcational program 
that have brought about the gains recorded by the 
evaluation. The first of these criticisms is more 
sweeping but less universally offered; the second 
is Jess controversial. In addressing the second 
criticism, studies of opportunity to learn are, in 
effect, bypassing the first. Yet, achievement 
tests have been summarily rejected as a valid 
basis for educational evaluation by large numbers 
of educators. Among the reasons given are: 

(I) Achievement tests ore restricted in their 
content to factual material and specific 
skills. Such tests fail to indicate 
whether or not the child has been 
grounded in the material to ^e learned, 
how it fits into his cognitive framework, 
whether he understands why and how the 
information is to be used. 



(2) In dealing exclusively with ffiictual infor- 
mation ofKi concrete skills, achievement 
tests fair to assess the nriore general- 
liable skills of cognitive functioning- 
^roblenrwsolving ability, criglnality and 
resourcefulrtess, and the ability to com- 
municate ideas and informotior). 

(3) Achievement tests do not deal with the 
affective dimensions of school ex- 
perience—with the child's feelings dbout 
himself, his degree of self-knowledge, 
and his obility to relate to other's. 

These criticisms momtain that achTevenr>ent tests 
provide' a skewed assessment of how children are 
influenced by their school experience. Moreover, 
the nneasurement of those aspects that are 
covered by the test is flawed by the speeded, 
pqper-and-pencil, multiple-choice format of the 
test. The test format dictates an urxkie emphasis 
oh discrete fragments of information. As a result, 
test performance of young children is largely' 
determined by the rate at which they hove learned 
to. read and by the amount of experience they 
have had in dealing with worksheets. Research in 
opportunity to learn and engaged time gives the 
appearance that these familiar criticisms of 
ochievement tests do not exist. Without explicitly 
endorsipg achievement tests, research in 
opportunity to learn and engaged time is built on a 
foundation of achievement test data. 

Opportunity to Learn and Engoged Time as Inter- 
vening Variables Rather Than Causal Foctors 

While the variables of opportunity to learn and 
engaged time ore clearly antecedent to the 
measurement of achievement gains, they are at 
the same time the consequences of the child's 
ability to cope with the expectations and demands 
of school life. The depth of a child's learning is 
influenced by characteristics of the child as well 
as by the quality of instruction. Opportunity to 
learn and engaged time frequently mediate 
achievement gains; they do not necessarily bring 
ttrem about. Some children fall behind in their 
school work because they have been absent, and 
others are absent because they have fallen behind' 
(and then they fall further behind). Engaged time, 
too, is better viewed as resulting from on interac- 
tion between th^ characteristics of the learner 
and the mode of teaching than as a manipuloble 
determinant of educational progress. How much 
time a child spends in on activity in school is a 
reflection of many foctors. If Dutch educational 
psychologists had conducted a study of Leiden 
elementary schoolchildren in the late 1600% they 
would have been wrong to conclude that, if all 
other 2d groders had spent os much time drawing 
and painting as little Rembrandt von Rijns (more 
than three times the median for his age level), 
they, too, would hove developed a fine proficiency 
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in the grcphic arts. On the other hand, observo-* 
• fions in the Leipzig schools 40 yeors* later would 
hove yielded other results. Gottfried von Leibniz 
was so swift in» calculating that he was m the 
lowest decile of engaged tinne in mathematics 
seatwork. While most of his fellow 2nd graders 
were busily working out three-digit addition prob- 
lems, Gottfried., hod long connpleted his assign- 
ments and was usually found reading a comic 
book. Engaged tinrie scores do not always reflect 
teaching effectiveness, nor are they invariably 
associated with excellence of performance. 

One way of sharpening the meaning of engaged 
'time dota is to contrast the variance of such 
scores obtained within and between classrooms. 
The wL thin-classroom varionce is more likely to be 
associated with individ^o.^ differences in djility 
and responsiveness to classroom activity, whereas 
variance among different classrooms is likel/ to 
reflect voriotion in teaching styles. However, 
there are pitfalls to this method of analysis. In 
some coses, variation in engoged time within the 
classroom may result from differences among 
work groups that reflect the teacher's organiza- 
tionol pattern, her teaching style. In other 
instances, a comporison among classes that afe 
comprised of different levels of homogeneous 
grouping or that were selected from schools with 
morkedly different populations could spuriously 
inflate the between-schools variance. 

The interpretation of engaged time data Is 
further clouded by the fact that teachers do not 
simply have children* randomly assigned to them. 
Teochers vary markedly in their capacity for 
tolerating the child with learning difficulties; 
those who use methods that are more supportive 
of children with learning problems are more likely 
to b^ assigned such children. Correspondingly, 
teochers who adopt high-pressure didactic 
methods often arrange transfers for those children 
who do not fit in with tlieir demanding pattern of 
instruction. The study of engaged time will surely 
be influenced by the extent to which teachers 
welcome ond support slow learners. Eng&ged time 
data may be expected to be consistently lower in 
classrooms of teachers who receive large numbers 
of slow learners because they are willing to work 
with them. This factor complicates our interpre- 
tation of correlations between engaged tinr»e ond 
teaching style. 



Misleading Aspects _of a Common Threod of 
Theory, Methoa, ond Research Findings 

The new research on opportunity to learn am' 
engaged time illustrates the manner in which the 
study of o problem is co-opted by key method- 



ological decisions. One decision dictates a seconcT 
that, in turn, leads to a third. They result in a 
series of interconnected events, mutually rein- 
forcing and circular, that lead to the formulation 
of a study in terms that predetermine the out - 
conr>e. Once the study of opportunity to learn 
becarr.e tied to a conception of educational 
progress defined by achievemej*, r test gains, the 
'research became embedded in a theoretical 
framework of traditional education. If educational 
imp^ict is defined in terms of the acquisition, of 
specific skills and bits of information thqt are 
measured by standardized ochievement tests, then 
opportunity to learn and engaged time must be 
defined, correspondingly, in terms of the condi- 
tions that facilitate rote learning. What is curious 
about this pattern is that what might seem to be 
the expec^-^d order of decisions is reversed, the 
choice of basic method leads to the adoption of a 
particular theoretical framework, which, in turn, 
dictates further methodological decisions. In this 
mutually reinforcing manner, an internally 
consistent but biased conceptual-methodological 
framework emerges that narrows the scope of the 
study and foreshadows its results. 

Those who view school influence from the 
developmental-interaction framework (see Shapiro 
and Biber, 1972), a. perspective that emphasizes 
the development of competence (White, 1959) and 
of coping skills (Murphy, 1962), are excluded by 
this perception of the problem. From the 
developmental-interaction viewpoint, schools 
function to strengthen the coping skills of children 
by broadening and deepening their experience and 
understanding of the world. Since each child's 
experience is distinctive, teaching and 'learning 
hove to be individualized. The development of 
competence is concerned with fostering 
autonomy, resourcefulness and curiosity, problem- 
solving ability, and self-awareness.^ It is apparent 
thot these goals coll for a dififerent set of 
educational strategies. Children must have an 
opportunity to function autonomously— to move 
about freely, to chat and discuss, to feel and smell 
and see as well as to listen— in order to deepen 
and integrate their understanding. The curriculum 
is designed to fit and enrich the child's own 
experiential bockground. In effect, children are 
expected to be engaged differently in school. 
Thus, how we define engoged time depends on our 
educational theory and our educat/onal objectives. 

As opportunity to learn and engaged time are 
currently being studied, it is assumed that 
children who are attending to the teacher's speech 
or busily involved' in writing or reading activity at 
their desks are participating more fully and 
effectively than children who are rapt in thought 
or who are talking wjth their peers. The validity 
of these questionable assumptions is being tested 
exclusively by means of the criterion of 
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ochicvemcnt test performance, which is prinrwrily 
sensitive to and designed to measure rote 
learning.^ 

Although the results of research on oppor- 
tunity to learn and engaged time ore just begin- 
ning to accumulate, and although those that have 
been completed have used quite different methods 
to define and measure the variable^ in question, 
the general pattern of findings indicates o positive 
correlation between achievement test gains and 
measures of opportunity ta learn or engaged time. 
The results are hailed by Rosenshine (1978) 
oecoose they seem to him to identify antecedents 
that con be manipulated to produce increases in 
ix:hievement test scores. Citing the results 
obtained by Stol lings and Koskowitz (1974), who 
found that time spent in reoding and mathematics 
was correlated with ochievennent, Rosenshine 
calls for research that will assess the impact of 
stepping i4> the pace of engaged tinr>e and identify 
optimal dosoge levels. He seenns unreody to 
entertain an alternative explanation af many of 
the findings: children who spend nrwe time 
working are better students to begin with. They 
are not better because they work more, they v^*ork 
mare because they ore better. If we ,waw 
Rosenshine's thinking ta its logical conclusion, 
then the data that show that children who attend 
school more regularly display greater gains in 
achievement should lead to large-scale hiring af 
attendance officers whose job it will be ta 
improve the attendance af logging students— os if 
attendance by itself will produce the desired 
effect. 

Thus, o set of interrelated decisions has 
transformed nn interesting research question into 
on exercise that yields a predictable body af 
findings. The choice of ochievement test gains as 
on index of educational progress has led ta o 
definition of engaged time ond opportunity to 
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Before we get further involved in the discussion 
of time, mention should be mode of mathe- 
matics. Mothemotics may have beep*- equally 
represented within each of the fQM^'groups of 
teachers, but it wos not equally discussed. 
Therefore, the majority of the discussion in this 
review focuses on reading instruction. Some of 
it moy be true for mathenrxitics^as well, But a 
clear feel for use of time in moth is still locking. 
It appears to nr>e in reviewing my notes that 
there is o block of stable time allocated to 
mothemotics of between 40 and 50 minutes o 
day. It doesn't hove the wide fluctuations of 
between 40 minutes ro 2h hours that reading 
does. It appears that the major constraint on 
mathematics is the amount of time that is 
subtracted for nrxinagement purposes. Once the 
teacher starts teoching OKith, most children ore 
doing mathematics. 



learn in terms of classroom octivitles and events 
that ore consistent with the kind of learning that 
is measured on ochievennent tests. In choosing to 
interpret the correlations found between eng<^^ 
time and achievement test gains as causally 
connected rather than as concomitant voridbles 
produced by a common third factor, researchers 
hove arrived at the conclusion with whic^ nr>Qny of 
them started— that direct instruction is the most 
efficient approach to education. Insteod of asking 
how each 5-hour day of schooling con be shaped to 
form o coherent and stimulating learning environ- 
ment that attempts to meet the principal develop- 
mental needs of each child, the results of research 
Oil opportunity to learn lead to recomnDendotions 
for adding 3-mihute increments in reading and 
arithmetic instruction to the regimen of .daily 
instruction. Further, by its use of achievement 
tests as definitive indices of educational progress, 
its way of defining and measuring engaged time, 
and the uncritical interpretation of findings, 
research in opportunity to learn has become o 
powerful supporter and promoter of troditional 
education* 

Because . the issues of opportunity to learn and 
engaged time ore intrinsically interesting and 
offer potential for improving the efficiency of 
teaching, the apportionment and use of time does 
merit study, hlowever, o functional analysis of 
this problem is exceedingly difficult to achieve 
because each transaction in the classroom serves 
o multiplicity of purposes. The use of fime can be 
assessed from an infinity of perspectives. Thus 
for, efforts to sfvdy this problem have been 
marred by the choice of mechanical, theoretically 
uninteresting bases for differentiating the use of 
time, premature concern with measuring the 
efficiency of use of time by invoking criteria of 
effectiveness whose validity >s widely questioned, 
and drawing unwarranted inferences from the 
findings. 

T he Instructionol Dinrwnsions Study^CTonference 

When NIE convened 40 teachers who hocl 
participated in the IDS and asked them to discuss 
the usefulness and relevance of doto regarding 
opportunity to learn, the results were Illuminat- 
ing. Much of tf>e initial discussion dealt with 
allocated time rather than engoged time. Many, 
but not oil, of the teochers emphasized that 
allocation of instructional time was governed by 
local or state regulations, so that they were not 
free to alter patterns of instructional time 
allocation. Nevertheless, they pointed out that 
there was nr>ore flexibility than appeared on the 
surface because reoding and arithmetic could be 
embedded in the teaching of social studies , 

For the most port, the teachers seemed very 
caught up in the mission of Title I and dedicated 
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to ochieving its objectives, but many roised 
<^iestion$ about some aspects of the programing. 
Some teachers expressed concern over the double 
dose of reading and arithmetic instruction that 
chorocterized their Title I program because it is 
being achieved at the expense of time for science 
and soctol studies. Is the negJect of these areas of 
instruction^ In effect, sowing the seeds of foilure 
in future years? The lock of exposure to concepts 
and information in science and social studies in 
the early grodes^ when combined with the meager 
experientiol background of many of the Title I 
children, might lead to the creation of evenr^more 
serlcos academic problems in loter grades^ 

Other teachers spoke of the importonce of 
saving time tor discussion ond creating 
opportunities for children to express themselves, 
thereby supporting the development of their self- 
image and their sense of individuolity* Some 
teachers felt thot the criticol needs of Title I 
programs reloted to the children's feelings about 
themselves and their limited obility to 
commuhicote; they believe thot the focus on 
academic troining is misguided* 

Discussion olso centered on the idea thot it 
was not only the .amount but the quolity of 
instructional time thot mottered. Smoll-group 
instruction was reported to be much more effec- 
tive thon lorge-group teoching. On the other 
hand, in some coses the extro, more intense 
instruction especiolly provided for Title I children 
was offered by o seporote tutoriol stoff thot 
functioned independently from the regulor class- 
room teacher. As o result, this group of children 
who were especially in need of strengthening their 
integrotive functioning was being subjected to o 
disjointed and fragmented mode of instruction. 

Problems of discipline olso offected decisions 
regording which children should be tutored. There 
is continuing pressure to remove disruptive 
children from the class. Indeed, mony children 
who were unable to benefit from clossroom 
instruction functioned more effectively in the less 
rigid situation of o leorning loborotory. 



In describing how instructional time was being 
used in the classroom, it became apparent that 
many teochers in the IDS classrooms worked ot o 
stepped-up pace. They referred to the voriety of 
curriculum pockoges thot their district was using 
to accelerote the poce of learning. For the most 
part, they seemed to like these additional curricu- 
lum and text/workbook materiols. However, they 
believed tt>at Title I teachers were in o better 
position to nxike decisions about the ol location cf 
instructional time than district administrators 
who were less fomilior with the needs of the 
chilc^en and the realities of classroom life. They 



seemed ready to accept a prescription of time 
ollpcotion but wanted it to be mode locolly. 

When asked how instructionol time could be 
deployed more efffciently, most members of this 
highly motivated and capable group of teachers 
believed that classroom time was being used 
efficiently. They contended thot most instances 
of children sitting oround and not working were- 
likely To be found among the brighter children who 
had olreody completed their work ond were 
woiting for the others to finish so thot they could ^ 
move on. 

The fact thot children performed better on 
items whose content hod been included in class- 
room instruction did not couse surprises No 
teacher reported having occess in odvonce to the 
test and giving children instruction or practice on 
fUe octuol items of the test, but many teachers 
indicoted thot it was customory to provide troin- 
ing on the type of inquiry used by the test to be 
odministered. In some districts, children ore 
given extensive experience with the item types 
thot will oppeor oh the test they ore about to 
take. 

Many of the teachers SF>oke of the great 
omount of testing thot was going on in their 
school districts, so much thot it was making 
inroads into instructionol time. Teachers seemed 
to hove mixed feelings about the role of testing. 
While mony felt thot testing hod become exces- 
sive, most occepted the notion thot testing repre- 
sented the best method for assessing the educo- 
tional progress mode by the children. They were 
well ottuned to the needs for testing ond the ins 
ond outs of preparing children for this method of 
measuring their ochievement. Some teachers 
deplored the fact thot the entire progrom 
evoluotion rested on test performonce, question- 
ing their volidity by observing thot tests measure 
whot con be meosured rother thon whot should be 
measured. They much preferred locolly created 
tests, those devised on the basis of g locol 
formulotion of educational , objectives. They 
disliked nationally normed tests, tests "that were 
less relevont to the octuolities of their instruc- 
tional program ond the characteristics of the 
children they were testing.^ 

The concept of opportunity to learn did not 
seem to this group of experienced teachers to be 
one that might lead to o revision in their way of 
teaching. They are too fomilior with the realities 
of day-toKloy teaching and the complexities of 



One solution to the overtesting problem might be 
to do on expanded anchor test study. This would 
permit cross-instrumentotion comparisons with- 
out octuaJly testing children. . The current 
norming informotion is too weak to reolly use. 



ctearoom life to embroce o concept thot -:Is 
introdiced by the research worldJn ctetroct end 
sinr«>listic terms, especiolix a cpiicept with which 
: they are alreody grappling In^more sophisticated 
teirm. The opporfunlty to discuss the results of 
the IDS with a group of teochers helped to shed 
new light *on the source of variation of some of 



the Independent voridbies. At the same time. It 
helped to lay bare the dtsparity hetween the 
ooncms of ttie dosaroom teacher and those of 
the researcher. It also demonstrated how the 
nriethodologlcal premises of researchers, as %»ell as 
their findings, can come to Influence educational 
policy. _ 
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Introduction \ ^ 

The Instructional Dimensions / Stud/ (IDS) 
examined the effects of selected /compensatory 
education program characteristic^ . on student 
achievement. One feature of / cbmpensoiory 
instruction which was investigated was relative 
effectiveness of-pullout and moiiistreom instruc- 
tion,' The research showed /the mainstream 
setting to be significantly better for grade I 
reading and arithmetic and grade 3 reading. For 
grade 3 math there was no difference. ^ 

-Given the prevalence- of puMout Title I in- 
struction, the study results indicated a need for 
careful; review of setting effects upon student 
achievement^ particularly that of Ist-grade stu- 
dents. The IDS^- Conference was convened to 
discuss study findings with a sample of partici- 
pating teachers. As part of the agenda of the 
conference, discussions were held to identify 
features of mainstream and pullout instruction 
that accounted for high student gains. The ses- 
sions on setting addressed the following questions: 
^ ■ * 

(1) How 4ire Title I programs being imple- 
mented? . 

(2) What impact does the Title I program 
have on students and teachers? 

(3) What , ore the advantages and disad- 
vantages of rTKiinstream and pullout 
instruction? 

Since the instructional setting element was 
used only as a blocking variable in the IDS (Poynor 
et oJ., 1977), teachers' responses to these ques- 
tions provided a contextual frame for interpreting 



Pullout instruction is defined as supplemental 
instruction that is delivered outside the regular 
classroom. Mainstream instruction is supple- 
mental instruction delivered within the regular 
classroom. 



study findings. The report that follows is a 
practitioner's synthesis of teacher responses to 
■ the above questions, with accompanying re- 
flections. This insider/outsider perspective will 
provide some insight to the elements of teaching 
activities and classroom experiences that contrib- 
ute to^whot children learn in schools./ 

Proctitioner Responses 

Implementation . Teacher participants at the 
IDS workshop described Title I - instructional set- 
tings in terms of who, where, how, and, oc- 
casionally, when compensatory instruction was 
delivered; The criteria teachers employed to 
categorize programs as "moinstreom" or '^llout" 
were based on their perceptions of personal roles 
and responsibilities associated with initiating, 
reinforcing, or reteoching a skill or "concept. 
Mainstream setting was typically used to refer to 
compen^atpry instruction provided to Title I 
' benefi<^i^ in regular classrooms. The regular 
classroom teacher assumed pfinKiry responsibility 
for instructional planning; directing and managing 
the activities of other certified or norxrertified 
teaching personnel; and monitoring, evaluating, 
and reporting student progress. 

Teachers discussed two types of mainstream 
settings. In or>e, the regular classroom teacher 
provic^ compensatory instruction iot Title I 
children in the regular classroom, assisted by 
auxiliary personnel such as pdroprofessiorKils and 
preservice interns. Auxiliary personnel were 
funded by Title 4, although school district re- 
sources often augmented Title I monies. The 
regular classroom teacher assumed total respon- 
sibility for identifying children's learning needs, 
organizing and planning instructional events, and 
directing the activities of auxiliary personnel. 

In the second type of nrKiinstreanri setting, a 
reading or nwth specialist or other Title l-funded 
staff person came into the regular classroom to 
provide instruction for children who qualified for 



assistance under Title I guidelines. The children 
were either referred to the specialist by the 
classroom teocher or identified through a testing 
program; often both procedures were used. With 
this type of setting, the classroom teacher and the 
.Title I specialist jointly planned for the 
instruction of Title I students, but the classroom 
teacher initiated the instructional events aid the 
Title I specialist reinforced tf>e instruction. 

In pullout settings, compensatory ^Instruction 
• was typically provided to Title I students in a 
spoce designated as a lob or resource room. A 
reading or moth specialist assumed primary 
responsibility for instrucfiofxil planning, for 
recommending to the classroom teacher other 
activities in which the {(Rorner might oppropriotely 
be engaged, and for monitoring and evaluating 
/ student progress. 

/ Teachers described two varieties of pullout 
instruction. In one variety, students were re- 
ferred by the classroom teacher or were identified 
through testing procedures. The regular closs- 
rooni teacher and the specialist conferrefSl formal- 
ly OS well as informally to mqnjtor each child's 
progress and to plan future Instruction. The 
specialist, however, initiated instrt^ction in a skill 
.qreo, and the regular clossroonni^ teacher rein- 
foiced the instruction by providing classroom 
experiences and activities which- gave the child 
the opportunity to apply the skills learned. 

In the second type of pullout instruction, the 
cidisroom teacher idehtified instructional needs 
of Title I children orKj sfsni them to the laboratory 
or resource room for this instruction. This room, 
uwolly ftiuipped with special nrwteriols as well as 
Kirdwore such as tape recorders and cassette 
viewer.% was staffed by Title I personnel who may 
or may not have been certified teachers. The 
classroom teacher conferred with Title I personnel 
to monitor and evaluate student progress. 

In a hybrid variety described by one reading 
specialist, entire classrooms attended the reading 
Icb daily. The regular classroom tebcher taught 
non-Title I youngsters at the; sonrte time that the 
reoding specialist taught Title I children. The 
regular classroom teocher and the reading special- 
ist jointly planned the reading instructional events 
for both groups of children. Instructional 
assistance was provided by two aides— the class- 
room teacher's aide and the reading specialist's 
aide. 

Impact of Mainstreanr) and Pullout Settings on 
Students . Worksho(> facilitators focused on 
several claims assembled from conventional wis- 
dom that oddres^ the impact of mainstream and 
pullout instruction for students and teachers. 
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Workshop participants* comments suggest that 
teachers ore primarily concerned about children— 
their social development (i.e., peer interactions), 
their self-image, and their motivotwn level. 
Teachers* comments also addressed the issue of 
stigmotizirtg children. 

Accordir>g to conventional wisdom, main- 
stream instruction stigmatizes compensatory Edu- 
cation studenfs by having extra instruction occur 
in the. presence of peers^ Pullout instruction is,^ 
believed to stigmatize compensatory education'' 
students by making them easily identifiable. 
Teachers advocating nrkiiristream instruction 
indicated that peer ond parental pressure result 
when children leave the room for instruction. A 
teacher from a Florida school district clearly arkJ 
emphoticplJy reported, "Parents dpnt like it when 
theii- children have vnore than one teacher." 

A Michigan teacher favored pullout Instruction 
* because of the opportunity, it provided for children 
to r -confront and overcome their , perceived 
inadequacy. She said, "Children know they dont 
know how to read. The pullout situation give? 
them 0 chance to do something about jt with 
someone who. understands their problem." 

Most teachers working in pullout programs 
acknowledged that compensatory education stu- 
dents were stigmatized and that this created 
rnanagement problems. Its negative impact on 
Title r youngsters Was reduced by practices such 
' as open and frank classroom di^ussions concern- 
ing ocadefnic, physical, and cultural differences; 
ongoing counseJing for oil children to encourage 
empathy and improve classroom relationships 
among peers; and providing opportunities for Title 
I children to perform successfully in other school 
and classroom situations. 

Most of ^the teachers attending the workshop 
came from districts ip which the pullout setting 
was preferred for deliverir)g compensatory readir)g 
orKi nrKithemotics instruction. Regordirig stigmoti- 
ration, they observed that students ore not 
labeled in building or classroom environnr>ents 
characterized by frequent nnovement and a lot of 
activity (for example, special prograhns for gifted 
and talented youngsters). 

Fewer reports of stjgmatizotion were associ- 
ated with conr>pensatory education programs 
employing "systems", instructional formats in 
which all children were simultaneously erigaged in 
^^.leornirig tasks in a common skills area (for 
example, comprehension, study skills, or analyt- 
ical skills). Systems instructional formats ore 
characterized by continuous gr^oupings and re- 
groupings according to test performance. This 
procedure encouraged flexible grouping arrange- 



mcots. AAore Importantly, teachers believed that 
sty<itnU\ perceptions of the similarity of instruc- 
tioioi content area among class members mini- 
rnized Title I children's feelings of •1>eing 
different" and classmates' perceptions of Title I 
children as "weird." 

Teachers otiributed reduced stigrirjdtization to 
the minimizo'^ion of differences in instructional 
content creos to which compensatory and 
noncompensatory education ^ students were ex- 
posed. Within each content area student objec- 
tives were formulated, children were grouped 
homr>geneously; and subsequent study tasks and 
mater:als were varied according to level of 
student performance on skills measures. 

To summarize, the potential for stigmatizing 
Title I youngsters exists in both moinistreom and 
pullqut settings. However, compensatory educa- 
tion students ore less likely to be subjected to 
labeling qnd its negative effects in environments 
where teachers actively encourage children's 
respect for and appreciotton of o variety of human 
differences; in environments where similarities 
between learning tasks and nrxiteriols are 
emphasized; and in environments where Title I and. 
. non-Title I children frequently move, in an organ- 
ized way, to other parts of the building or 
classroom to receive special instruction. 

Impoct of Mainstream and Pullout Instruc - 
tion on leachers .- leocher porticiponts at th#> in<; 
workshop offered several compelling arguments in 
favor of, and in opposition to, both varieties of 
Title I instructional settings. Mainstream settings 
provided opportunities for the classroom teacher 
to observe chiWren's academic performance and 
their reactions to other instructional techniques 
and odulf personalities. In turn, it was believed 
that observations • could lead to increased 
instructional effectiveness. Workshop partici- 
pants captioned, however, that the advantage^ 
which observation offers classroom teachers can 
be confounded by negative foe tors such as limited 
or inadequate materials "and classroom space, 
increased recordkeeping, ond.plonning "overload." 

Pullout settings offer the odvontages of 
increased communication between classroom and 
specialist teachers, of providing a model of adult 
cooperation for children to emulate, and of 
supporting the child's persevering efforts which 
lead to increased confidence. Mainstream ^ 
odvocotes quickly cautioned that pullout settings 
are oUen viewed as intrusions, particularly when 
the specialist is perceived as o monitor or evolu- 
otor of the classroom teacher's practices. Addi- 
tionally, several workshop participants criticized 
pullout varieties of compensatory education for 



interrupting the continuity 'of instruction and 
inhibiting "follow through." 

Teachers did not express a high level of 
consensus on the issue. Each of the positions 
advanced in favor of, and in opposition to, main- 
stream and pullout compensatory education sug- 
gests that the relative effectiveness of either 
vorrety is related to teaching and administrative 
practices. 

Characteristics of Well-Coordinated Title I 
Programs . According to teachers' repprts, most' 
well -coordinated Title I programs, whether main- 
stream or pullout, use similar planning methods 
and hove similar amounts of administrative sup- 
port for autonomy and flexibility in scheduTTng 

(I) Planning . Well-coordinated programs 
seemed to be characterized by Jaint planning. 
Much cooperation and conirnunicotjon,' both; for- 
mal and informal, occurred between the regular 
classroom teacher, specialist teacher, and 'oux- 
iliory personnel. Additionally, planning thot was 
both systematic and flexible was thought ^ti3 
facilitate motch^ing between classroom instruc- 
tional events, learner's needs, (and district or 
building goals. This kind of planning also was 
believed to facilitate consistency between kinds 
of skills being taught in mainstream or pullout 
sftuotions and to lead to clear definitions of 
responsibilities and functions among oil adults who 
contributed to the children's instruction. 

(2) Administrative^ Support for Autonomy . 
Classroom teachers and specialists who had high 
degrees of autonomy attributed the success of 
their respective Title I programs to increased 
decisionmaking roles. Reported indicators of 
odninistrotive support included allocation of 
released time for planning, parity in decision- 
making regarding the employment of auxiliary 
persbnnely and freedom to exercise professional 
judgment in curriculufn matters such as instruc- 
tional^ goals orxi in classroom procedures such as 
grouping arrangements. 

(3) Flexible Scheduling . In well-coordinated 
programs. Title I children received compensatory 
academic instruction without being denied partici- 
pation in other school enrichment activities 
(music, art, and physical education, for, example). 
Flexible schedules that allowed Title I children to 
perform successfully in a variety of nonacodemic 
situations reportedly helped to increase student 
motivation and self-esteem. 

Analysis of Practitioner Responses 

Theoretical Perspective . The questions 
posed in the IDS Conference session on setting 
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hove ^roditionolly been the focus of inquiry for 
orgonizotionoi^ and educotionol sociologists. 
Considerable attention has been paid to the chor- 
octeristics of work sites and settings, to repeti- 
tive relationships occurring ttiere, ond to the 
delineation and analysts of tasks (Brookover, 1955; 
Bidwell, 1965; Jackson, JSr^y Lortie, 1975; Spady/ 
1976). TheMmplicit assumption underlying suchl 
inquiry is that certain organizational propertiies of 
schools' and classrponrts hove inripncations for the 
nature, quantity, and quality of teachers* work, 
teacher-pupil interaction styles./ and student 
outcomes. . ^ 

Dunkin and Biddle*s discussion, "The Class- 
room as a Social System" (1974), identified several 
categories of clossroom^setting variables, includ- 
ing lesson and activity/^forlriats, classroom pro- 
cesses arid events, and "physical , characteristics of 
the classroom environment. After careful review 
of several substantive reports, Dunkin and Biddle 
moke the following observations regarding effects 
of classroom features on student ochievement: • 

Subject motter' is found to affect the lesson 
format, with mothematics featuring a closer, 
more formal relationship between group func- 
. tion and structure . than social studies . . . 
teacher age and sex also affect format... 
(however) none of .the format dis- 
tinctions . . . has been applied in process-pro- 
duct research, (pp. 209-211) 

Teacher role in classroom processes ss also 
found to affect, or be affected by, a wide 
variety of other events in the classroom, 
including lesson format, group function, and 
classroom location .... Altogether, findings 
for teacher role ore more suggestive than 
those for lesson format,, but we have even less 
evidence of their usefulness in predicting the 
effectiveness of teaching, (p. 218) 

Roughly d dozen findings report relationships 
between other kinds of classroom events and 
pupil roles .... Although suggestive, these 
findings are— once again— ds yet unavailable by 
process-product research, (p. 220) 



Regording other features of the classroom 
environment, Dunkin and Biddle indicate that 
"investigators ore not in complete agreement on 
how to conceptualize the physical environment of 
the classroom" (p. 226). 

. Critical of the treatment of a diverse array of 
edxotional setting variobles in previous studies 
"as separable from one another, linear and 
odditive," Bronfenbrenner (1976) posited an 
ecological systems view of the educational en- 



/ / 
vironment. From his vl^, the educotlond en- 
vironment was cainceptgalized as a nested ar- 
rangement of four successive system structures- 
micro-, meso-i exo-, and mocrosystemic^which 
account for what happem or foils to happen in an 
educational setting. For Bronfenbreriner, the 
educational envir.ohment/of a lefamer encompassed 

Jxith immgdiote an d / larger social contexts. 

Hence, sy^ems properties and processes "affect, 
OfKl ore affected by, the t>ehavior and develop- 
ment of the lekirner." '/ 



\ 

When applied to- \ the school .environment, 
^ Bronfenbrenner's conceptual analysis of the ''eco- 
logical structure of /educational environments 
leads to the following set of generalizations. 
(I) The learner's Imm^iote setting is the class- 
room— a place in which the learner engages in 



particular 
particular 



activitie s 
periods 



in 
of 



0 porticulo;; role for 
time. (2) Interrelations 



among several sets of settings (classroom, library, 
resource room, playground, etc.) comprise the 
learner's instructional setting. , At another level, 
the instructional settings lembijace formal and 
informai social structyi^s that Influence, shape, 
and ddilimit what ,'l4ar;iers do within the 



school. \. (3) The orj 
schools limplicity oi 
efforts of teachers, 
parents, etc., in the 
structure^ in combi 
environment and endbw 
all persons in. the school 




tional structures of 
icitly mobilize the 
rs, support personnel, 
environment. These 
constitute the school 
irig to the activity of 



These generalizations|/are heuristicolly useful 
as 0 conceptual tool f orrdisCQvering the relevant 
dimensions of instructiofidl setting perceived by 
IDS Wbrkshop porticiponjts. Application of Bron- 
fenbrenner's conceptual model to practitioners- 
described school environmental features permits a 
retrospecti>jre reconstruction of compensatory 
education injstructionol settings. 

Classrooms . Group cohesion, and the proc- 
esses teachers use to develop it, appears to be a 
classroom characteristic. Teachers use group 
cohesion to "set the stage" for instruction and 
learning in compensatory education instructional 
settings. The concern that teachers expressed* 
regarding breakdowns in classroom peer relation- 
ship patterns indicates that teachers perceive a 
relationship between Title I student achievement 
and (I) patterns of classroom movement and 
activity and. (2) instructional grouping arrange- 
ments. The uniform practices teachers employed 
in remedying stigmotizotion suggest that develop- 
ment of group cohesion is an antecedent of ef- 
fective instruction and learning. 

Instructional Process Dirnensions. In well- 
coordlnoted programs. Title I learners received 



-7 



.36 , 



j instruction which con be described as frequent and 
\ repeated over the available time period. The 
formol and informal cooperatioOy canrvnunicatian, 
and joint planning among teachers allowed 
compensatory educotioa students to study specific 
skills or concepts in a number af different lesson 
formats. Joint planning also encouraged \ con- 
siderable repetition. As one teacher explained it, 
"Our Title I children receive several doses of 
instruction in a selected content area." \ 

For Title. I learners, the instructional setting 
also appears ta4)e characterized by 'instructional 
formats in which skills and concepts are intro- 
duced, reinforced, and retought according to 
identified performance heeds. Ongoing, callob- 
orotive monitoring of student progress focifitoted 
the modification and revision of instructional 
sequencing and pacing. 

Well-coordinated Title' I progr ami were chqr- 
obterized \>y^ clearly defined areas of responsi-.- 
bill ty among all adults whp wereJnvolved directly 
or indirectly with instructing Tit^e I beneficiaries. 
IDS teqchers perceived clear divisions of ;jab 
function mode according to their responsibijity; for 
initiating,- reinforcing, and reteochipg skills fond 
concepts which facilitated consistency \ in 
instructional formot. These clear delineations of 
instrukctionol functions seem to cr^pte / and 
maintain content consistency far *the Title I 
learner. By providing uniformity af purpose and 
direction for Title I instructional efforts, the 
division of labor provided on accompanying 
perceptual focus for learner activity and behavior. 

School Setting . Key aspects of compfensatbry 
education school settings include: (D releasefl 
time far planning; (2) administrative, support for 
autonomy; and (3) flexible scheduling. 

Released planning time seemed.-^to relate ,ta 
teachers' opportunities to select and review 
materials, to assess Student progress, and ta 
develop strategies far meeting learners* needs. 
Equally importont was the opportunity provided 
for collaboration between teachers' aides or ^ 
Title I personnel and the regular classroom teach- 
er. 

Administrative support far autonomy ollowed 
teachers to assume o greater share a f responsi- 
bility and control in structuring the learning i 
environment relative ta curriculum and instruc- | 
tion. ^ Since classroom and subject area teachers | 
performed delineated tasks in the Instruction af i 
Title I beneficiaries, it is likely^ that substgntiol^ 
effort was nrwde ta utilize effectively existing 
temporal, spatial, material, and human support 
r^rsources. 



Teachers reported that schedule flexibility 
allawed Title I children to perform successfully in 
a variety of nonacodemic plasses such ds music, 
art, and physical educationj thus contributing, 
positively ta the children's increased motivation 
and self-esteem. Flexible schedules ..olsa per- 
mitted teachers to utilize instructional time 
differentially to meet learners' academic needs. 
Time utilization thus carries implications far the 
intensity of instruction received by the Title I 
learners 
'■ - 

s 

:^ Scheduled time prescribes the broad durational 
parameters in whfch Instruction occurs. Schedules 
olsa contribute ta the shaping and delimiting af 
possible instructional arrangements that can 
occur, such as peer tutoring ar lab usage. Flexible 
schedules provide oppartunities for teachers to 
vary the emphasis placed an certain aspects of 
instruction at differept'-points along on instruc- 
tional continuum, e.g., initiating, reinforcing,- and 
reteoching skills and concepts. Several teachers 
reported that unscheduled timeframes are used to, 
provide additional instruction for learners who 
' experience difficulty. Supplementary instruction 
' oUowed learners to complete tasks under 
supervision- and to gain additional practice in 
specific skill/content areas. 



Teachers' comments suggest that schedule: 
flexibility permitted them to vary the amount of 
time in which a learner is engaged in a given task. 
Additionally, teachers could vary the quality of 
supervision provided and exercise greater control 
.over the le^arning strategies that their students 
used. Despite absence of time utilization data, 
workshop participants' reports suggest that 
intense instruction and considerable instructional 
continuity exist in compensatory education set- 
tings where teachers assume significant responsi- 
bility for manipulating temporal features of the 
instructional setting, i 

Concluding Thoughts 

The preceding setting analysis explored 
teacher-reported dimensions of compensatory 
education instructional environments that affect 
Title I student autcomes. Although the "main- 
Stream" and"pullout" setting dichotomy may hove 
served as a convenient partitioning dimension for 
reporting Title I student achievement data, the 
designations by themselves reveal little about the 
nature of relationships between classroom 
processes and Title I student achievement. IDS 
findings may. be more useful if viewed as indica- 
tors of factors that impinge upon and affect the 
instructional environment in compensatory educa- 
tion school and classroom settings. 
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Specific IDS cio^obm process variables that 
related to Title I student gains in the 1st grade 
inblude: (I) amount of time (reading^ (2) curricu- 
lum overlap (reading);^ and (3) assignments and 
grouping (moth). For 34-grade gains, significant! 
clossroom process variables ore: (I) amount of 
time (math); (2) matching by mastery (reading and 
math); and (3) curriculum overlap (reading and 
math). Repetitive classroom process dimensions 
across both grades are c^urriculum overlap and 
amount of time. 

These reported classroom process findings are 
compotible with teachers' descriptions of instruc- 
tional settings. For the procitioner, curriculum 
overlop related to (I) Instructional format and 
content consistency and (2) amount of repetition 
that resulted. As noted eorlieri joint plahning and 
collaborative monitoring bf student progress 
facilitated teachers' ability to provide a unified 
instructional pro^-om for Title I iearners. 

Teachers regarded schedule flexibility as a key 
instructional setting feature. Earlier it was 
observed that flexible schedules would, permit 
tedchers to vary instructional intensity according 
to learners' needs. IDS findings regarding time 
allocation are based on interview data concerning 
regularly scheduled compensatory " education 
instruction. The need practitioners expressed for 
schedule flexibility strongly suggests that when 
the pkirameters of allocated tfme within a 
schoolddy are sufficiently fluid, other-directed 
instructional experiences are provided. Varied 
intensity permits supplementary instruction (i.e., 
intervention, remediation) to occur when students 



experience difficulty. Varied Intensity con 
encourage success and ' increased competence 
which, in^tum, Increose student motivation. 

It was also noted that flexible scheduling 
provided opportunities for Title I children to 
participate In school enrichment activities such as 
art, music, and physical education. These experi- 
ences permitted Title I learners to perform suc- 
cessfully in nonocodemlc situations, and to gain 
peer acceptance and respect. TeacheVs noted that 
the increase in motivation and self-esteem that 
resulted was^ positively related to achlevemient 
gains. 

Assignments and grouping were found to be 
associated with high achievement only for Ist- 
grode student gains in math. Workshop partici- 
pants revealed little that would provide insight 
into relevant setting dimensions contributing to 
this phenomenon. Matching by mastery was a 
uniquely significant factor for 3d-grade student 
gains in reading and math. Again, workshop 
porticipants' responses did not uncover any con- 
nections with instructional setting. 

The IDS is unique in its attempt to identify and 
isolate environmental variables that occount for 
student achievement gains in compensatory edu- 
cation. Previous studies failed to uncover pro- 
cess/product connections. The methodological 
prpcedures employed in the conduct of the study 
during the data collection and interpretation/anal- 
ysis phases has contributed to the discovery of 
relevant setting features that affect cpmpensq- 
tory education student gains. 
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- The post decade has witnessed on increasing 
sar^hflty to th« brood Pdhge of conrpetencies 
«|*Ai?^ developed by children os they learn in 
7"* •etthg. Setting is a complex concept, 
InvoMng the verbal and nonverbal behavior of 
puMren and others which oocbmponics the per- 
ceptual, physlcQl, ond social properties of the 
people, flbiects, and events invohwd in that 
behovlor. 1 For ewiniple, the teacher, the child, 

„ Jr*** Interacting in various role 

relatlomhipe bi a classroom during a givea 
•ehooldoy. These f&ctors oil contribute to the 
learning environment of the child. The Impor- 
tance of setting in educotional 'matters might be 
seen. In foct, as analogous to the importance of 
context in language shidy.' For yeors, linguistic 
wartc has fbcUwd on the universais and the brood 
gsnerolities which 'characterize a language. Only 
wrtWn the post decade, however, hove linguists" 
begun to examine the context or the setting in 
ordsr to understortd the variability of language to 
o fuller extent iHymn, I974X Unguists realized 
that this varhbilltr broujW ridwwss to kMuoge- 
expression and oHemoth^ways of understfdndng 
and preAicIng nuances, «nd that however Impor- 
tant the g«wralities ^ond universais ore, pur 
humanity Is clearly revealed throu{^ our vari<i>il|. 
ty. It Is the use of this variability. In fact, which 

— for indhrfduol exiirdillon, opt phroelng, and 
loetry. The dsveiwTy i t of loelolln^tics 

In the part decade w aohasCmn cridence of the 
growing concern for ssitting In educational Issues. 
H is not surprising, thetS thot education is 
eoncemed with «ie effect of setting on learning. 
We hov>e always known that context contributes 
hogylhr to chlldrerfS devefapme n t. It b only 
reoentlx, however, ttiot we have begun to spodfy 
Mw dimensians of context onough to begin to see 
•Mw It ocluaHy wortis. 

it Is with fhb boeiigraund that the DS 

dsed a fkst-out view of the effect of s 

Mttlng on feoming. Ae Ooom has pointed out» we 
comof deckle bet wee n oitemat^ve h i torpr e tutfcxi s 
•f »• aanrn behovlor wlMtowt o ^rstemotle onoly- 
m olf oonleRt. Gwnperz and Hsros l mdi u it» ki 
rtudy of toacher/studwTt kiterootkxv, show. 



that children moke use of a number' of variables 
such OS task exifectoncy, role differences, ond 
previous utterances ki the conversm:cn to fbrmu- 
, kito intefpretatkxtt and, thereby, to leom. I is 
not diffkKilt to extend this list of variables 
rekited to setting to inchxie factors rekited to 
cjoMToom placement, size, competing or simul- 
toneow activities, accoutrements, eiqulpment, and 
so forth. 

Although setting has been vie«ved in many 
woys, depending on the objectives of the observer, 
a systemotk; way of differentkiffng the possible 
perspectives called settbig has not been mode. 
Therefore, efforts to bring about policy-oriented 
research whfeh utilize setting as a focined dimen- 
sion moy prove- tfifficult. Some rekitlonships 
between setting and chlMrenV* looming will be 
direct. Ofliars will bejndirect. Some will affect 
some chikkren but not others and not always in the 
same ways. Such varkibles ore extremely difficult 
to control, and even when such control b attempt- 
ed, one is left with the observer^ paradex=that 
by controlling for the vortobles. the mgecMedMn- 
distorts the reotity of the experience t» «he 
extent that the research con be bivalMat«di The 
study of setting Is mothrated by its Interpretative, 
«!ipkinatory, and predfctive power. Uhless we 
understand chiMren better and guMe their educo- 
tlon more effeetlvely'as o result of such study, we 
cannot consider such.work as helpful. 



...J* «*♦ of understandings such as these thot 
Nie under16ok to detemUne the effect of one 
"x**" o^pect of settkig on tfie leomktg of certoki 
chlMren. Settbig is only one part of a ktrger" 
category of-infkwncss on ieombtg twhkA we shall 
refer to as .context. Four dlffermif Itypes of 
context have been wrog n jze d bi tht Htaroturet 
physicai, aitoatkinal, socbil, and llnguKfte. These 
categories ore by no means mutoolly exchnive, 
and most of the rocent tmprfc on longuoge context, 
for example, sees It dong with (rolher than 
««*ah»« from) physicol and sltuathmol contexts 
gco"«*, (976i. Cdntela^^ls not a fluid set df 
. properties of the worM whteh chiMreo take foito 
account as tfwy leom. Cook-GOnperz and 
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Corsaro (1970 consider dbote^ as port of the 
^ommihlcation and leomlngVprocess, a set of 
fluctuating variables which>dAe constantly being 
reevaluated by all par^^jpwts^ in the learning 
process during the interaction. 



Any policy implications growing out af the 
study of the effect of school setting in leorning 
need tc consider three very important questions: 

(1) Is there agreement or what it is that is 
being measured? 

(2) Does the research measure the right 
things? 

(3) Does the research assess at a definable 
and appropriate point af measurement 
potential? 

This paper discusses these three issues with the 
hope that by being clear on these aspects af 
educationol research, we stand a better chance af 
making progress toward assessing the setting af 
learning in such a way that policy decisions con be 
made effectively. It also suggests direction far 
future research. It is agreed that setting js an 
important variable which contributes to ©r 
detracts from learning. If effective policy de- 
cisions are to grow out of such study, we nr^d to 
<£scover how setting both helps and hinders 
learning. It b the thesis of this paper that oca- 
demic researchers have, to date, made little 
pro^'ess in Assessing the effect of setting of 
education because they have neither described it 
fully nor examined it deeply. Consequently policy 
decisions will be based, necessarily, an a rather 
shaky research base. 



Is There Agreement on What Is Being Measured? 

One reason why policy implications hove been 
difficult to moke regarding the effect of setting 
grows out of the very nature of this activity 
coMed research and evaluation. Such activity is, 
of itselfi unnatural, and it imposes compromises 
of one type or another. We have already 
mentioned the problem of the observer's paradox. 
Even purely observational study upsets the ecol- 
ogy of the classroom, instituting new and often 
difficult constraints. Alternatively, research and 
evaluation con carry out isolating types of studies 
in the following way: 

(1) Stop life long enough to look at it and 
determine what is going on 

(2) Decide ynhai to look at (also a decision 
obout what not to k>ok at) and what to 
consider as similar and what to consider 
as <fif ferent 



(3) Determine how much is enough to matter 

These two procedures, observational arid iso- 
lating, constitute evaluation circles. The former 
has the advantage of naturalness of data; the 
latter has the advantage af ease in analysis. Both 
must understand the dimensions of the topic well 
enough 'to know what to look far and do it at an 
appropriate time. 

Unfortunately, policyK>riented research seems - 
not to have the luxury of waiting for all the 
details which academic researchers feel are 
necessary. To fully understand the context of 
leaming^Caf which setting is one component), one 
should know a great deal about the dimensions of 
that context either to observe them in natural 
contexts or to isolate them for study exclusive of 
such contexts. Put even more simply, this merely 
soys that in order to measure something, one first 
has to know what it is that is critical to measure. 
Since policy decisions must be based on .such 
evidence, such decisions will be no better than the 
evidence upon which they ore based. 

In an effort to discover the effect of context 
on learning, the IDS reseorch examined one aspect 
of the physical property of context. This aspect 
was identified as pullout vs mainstreom 
instruction; that is, supplemental instruction 
delivered to students outside of the regular 
classroom vs supplemental instruction delivered 
inside the regular classroom. This definition 
seenr>ed har less enough unti I the i ssue was 
considered outside of the physical dimension 
alone. What do people perceive this contrast to 
be? What social events supersede or overlap its 
measurement? These questions would not be 
asked in a study which isolates for measurement 
one property by itself. 

Any comparison of moinstreoming with pullout 
classes is difficult to understand when there is no 
broadly ogreed-upon definition of these terms. If 
the terms were placed on a continuum, at least 
general agreement might exist concerning the 
polarities of meaning, but the middle aspects will 
be vogue and unspecified. Regardless of the 
definitions used for the purposes of the research, 
the 40 teachers assembled to discuss this project 
hod their own concepts of what pullout means. To 
some of them, any child taken from the regular 
class constituted a pullout. At the other extreme, 
one teacher reported that the whole class, includ- 
ing the teocher, was pulled out to the resource 
teacher's room. 

Despite the general definition used in the IDS, 
it should be clear that in the field there is not 
unanimous agreement as to which is which. Per- 
haps even more startling is that the teochers 
interviewed often praised or blomed one or the 
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©therof these setting strategies on bases not 
germane to the issue. Lobets pkay an extremely 
important role in education, and it appears that if 
we tell some teachers that they are in one of two 
different modes, many are willing to believe it, 
whether or not the modes are in ony way 
accurate* 

One thing obvious In the Instructiorral Oimen* 
sions Study is that the researchers and the 
teachers seemed to hove a great potential for 
seeing the settings in quite different lights. It is 
likely, in fact, that researchers would olso not 
necessarily agree with coch other about what it is 
they ore measuring. A great danger in evoluction 
is in assessing ,a feoture without defining it 
precisely ond without seeing it in on ecological 
balance. The IDS is no more guilty in this regard 
than is the brood field of knowledge. The state of 
the art hos not yei been adequately developed to 
assess this feature connpetently. 

Does the Research Measure the Right Things? - 

Assuming that researchers can ogree on the 
features being meosuredf on even greater question 
in the "so whof" issue. How do we know that the 
now agreed-upon ond well-defined feature really 
matters? Of all the things one might assess, why 
choose this one? 

Assessing the effectiveness of any national 
program involves great risk taking. The question 
of what to assess often gets short shrift in 
educational evaluation and may fall prey to the 
more visible and easily measurable (countable) 
issues. The setting of education seems to be of 
tremendous Importance, but it is certainly much 
larger and different in scope from the mainstream 
vs pullout dimensions noted here. Any science 
seeks explanotlons for events and behavior. These 
explanations are often found in the variables 
which are involved. The variables invoked in 
education, include the topic of instruction, the 
learners; the setting of instruction^ the teachers, 
and the delivery $yste»v^ itself (techniqueStrrKiteri- 
als, curriculum, etc.X ^ ' — -"'^v^ 

Even though the seHing of instruction is a 
critical variable, it cannot be seen In isolation 
from its co- and subvariables. In order to 
determine exoctly wtxit these other variables ore 
within the variable of context, one must occom- 
plish a number of tasks. Pulkxjt vs mainstream, 
OS a category, nxisks many voriables which con 
confound whatever results one might obtain by 
comparing these two features in isolation. Even 
some ckissroom observation instruments, os weak 
as these are, include several variables related to 
setting (attractiveness of the room, size, the 
noture of the seating, height of ceiling, lighting, 
etc.). These features, in themselves, are enough 



to couse binory comparisons between pullout and 
molnstream to be less than useful (see for 
example, Jane Stall ings). 

In the cose of reading, the setting is confound- 
ed by a number of other foctors. For one thing, 
reoding instruction, os Griffin (1 977) points out, is 
by no means limited to that portion of the day 
labeled "reading." By this she does not mean only 
thot •^very teoctm^ Isya reading teacher" or that 
there Is reading Trwolved in the content areas. 
Instead, she indipdfes from her research that 
comprehension is taught in such contexts as when 
teachers redd stories to their students when the 
children do a cooking experiment. To nr>easure 
reading ability, then, and to ascribe gain or loss 
based on whett>e^r or not the child was main- 
streamed or pulled out overlooks a great deal of 
learning which is irrelevant to either variable. 

Likewise, recent research by McDermott indi- 
cates that a great deal of learning which is not 
easily identified as reading is accomplishedTii 
reading groups in elementary schools. Children 
leam about tum taking (actually a very complex 
phenomenon with very subtle signals), how to 
know whether or not their efforts have been 
approved, how to seek clarification when they do 
not fully understand, and many other important 
social skills (McDermott, 1977b). 

An effort to evaluate reading instruction in a 
given classroom, therefore, will need to include 
more than the reader's achievement. It will need 
to observe ond record the conditions which help or 
hinder the reader's developnr>ent. Recent ethno- 
graphic studies of the classroom hove repealed 
some very interesting things. (For a comparison 
of quantitative and qualitative ossessment 
procedures, see the entire issue of Anthropology 
and Education (Suorterly, May 1977.) Such obser- 
votiOTKif procedures stand In stork controst to 
most evaluation efforts involving national profiles 
jn education (McDermott, 1977a). 

A somewhat different perspective to the 
importance of the classroom setting is offered by 
Cicourel (1974). Noting the imj^lonce «)f the 
literature on the limitations of attention, mem- 
ory, and types of recording procedures In most 
research, Cicourel observes: f 

If we con believe the importance of short-term 
memory In humon Information processing, then 
the consequences of a classroom lesson for 
learning by disodvontoged children ore 
especially serious. If short-term memory is a 
viable notion then new information being 
received requires some sort of rehearsal, and 
the copocity of the memory becomes central 
-because of the amount ond complexity of 
incoming information and its possible 
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dbplocement af other elements. A . . . tester 
would hove to be familiar with cor>ditions (I) in 
which certain types af acoustical and visual 
memory deteriorate; (2) in which conditions 
con InfluefKre the subject's ability to process 
informotion provided initially by standardized 
American Er^glish instructions that are acous- 
tically and partially visual; and (3) in which the 
instructions require a translation af verbal 
nrxiteriol into visual operations or standardized 
verbal operations, (p. 328) 

Cicourel goes on ta observe that current social 
ond behavioral science research places too much 
emphasis on the analysis af verbal materials 
detached from the setting and occasion af use and 
relies top much on the restricted occasions such 
OS fornw) t^sts. The displocement af visible and 
imagined objects and events can be reconstructed 
by some people much mare efficiently than 
others* Unless ttiese mare subtle otkJ difficult-to- 
study Issues of social interaction ore examined 
carefully, reseorchers cqn easily fall bock on a 
social pathology or genetic explanation of 
differential school performance (Cicourel, 1977, 
p. 332). If the children try to make use of what 
they considered to be common knowledge of the 
setting, and this knowledge is not the common 
knowledge af the school, they stand to be judged 
unfairly. 

To ogree to measure a component of setting, 
then, research must first identify a wide range of 
subvoriobles and then determine which ones sup- 
port orxJ which ones canfound the major variable 
and finally assess the extent o which this effect 
con be token. An example af this sort of error 
con be seen in the recent notional evoluotion of. 
bilinguol education via Title VII programs (Anneri- 
con Institutes for Research, 1978). This evoluo- 
tion took a very global view in which the octuol 
theoretical differences between progroms were 
never identified. As a result, programs were 
compored on the basis af unknown and potentially ^ 
irrelevant features. The results were useless to 
the gool af providing guidance to Congress for 
«4 future directions. It was assumed that the setting 
was being measured, but no effort was made to 
define the possible dimensions of setting, and no 
subvoriables or theoretical positions were consid- 
ered. 

The point here is that any evaluation of 
instruction is based on several possible theoretical 
stances. A decision to meosure early learning 
skills in Isolation from eoch other or from the 
gestalt of learning is q strong, theoretical decision 
which is subject to critical evaluation. The 
results af such meosurement ore only as good as 
the theory which undergirds it. Likewise, a 
holistic measurement will tell us little about the 
' eorly developmental fkiWs which preceded it. One 



should not be confused with the other. Both 
should be evaluated for how they con help us 
understand the ocquisition of learning. 

A consistent end appropriate learning theory is 
not the only necessity far a useful evaluation of 
the effect of setting. Also critical is a consistent 
and appropriate theory of the subject being 
taught. In the cose of reading, far example, it is 
necessary to know the content of reading, not just 
the methodology of delivering it to children. The 
content of reading js composed largely af 
linguistics, psychology, ond anthropology. 
Reoding is a longuoge-processing operation (lin- 
guistics), learned (psychology) within on overlap- 
ping set of cultural constraints orKl influences 
(anthropology). To evaluate such o phenomenon as 
reoding effectively is to know more than the 
traditional knowledge (or misinformation) about 
reoding. Much of what passes for traditional 
knowledge in this field is close to folklore. Great 
gaps of knowledge ore glassed over as though we 
really know the answers. 

In addition, any focus on the setting of 
education needs to consider the different sets of 
behavior ond discourse rules which ore in opera- 
tion. These sets stem from all of the *'nonsetting** 
variables such os oge, sex, socioeconomic status, 
ethnicity, and geographic region, as well as the 
more relevant educational setting conditions such 
as room size, ploce, and other more Ipcol environ- 
mental conditions. The entry of evaluation into a 
normal classroom setting creotes the observer's 
porodox: if we do not observe, we cannot tell 
what is going on; if we do observe, we upset the 
ecology of the classroom behavior. 

Are We Assessing a DefifKible and Appropriate 
Point of Meosurement? 

To nrKike an assessment of the influence of 
settir>g on learning, it is necessary to do it at on 
appropriate stage of development. To measure 
reading ability in the first month of schooling, fory 
example, would be ludicrously ill-timed. Like-) 
wise, to assess the early developmental walking^ 
skills of 0 moture normal adult would seem 
foolish. There ore clearly inappropriate points for 
evaluation. 

In order to ovoid inappropriate points of 
assessment, it is necessary to hove either clear 
and undisputoble research evidence as a 
touchstone or, barring such evidence, it is neces- 
sary to hove o reasoTKible and well-defined devel- 
opmental theory. 

For exomple, since reading is a language- 
processing operation, a theory of reading should 
primarily occount for language in the many ways 
it reveals itself developmentolly. In at least one 
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sense of the term, reoding con be viewed in a 
timeframe continuum in which eorly skills are 
developedi porodoxicallyy only to be abandoned as 
soon OS possible for advonced cognitive processes. 
Reading offers a rather clear example of a 
mixture of such early behavioral skills, later 
cognitive strategies, and a potential for cultural 
interpretation and individual learning style. Thus 
the setting of measurement con be seen to change 
radically from point to point on a timeframe 
continuum. Early reoding skills, such as letter- 
sound correspondences and word-port decoding, 
ore , clearly worth measuring at the time when 
such learning is going on. But they are early 
developnnental skills which, when a reader later 
becomes proficient, become so outonrKitic that the 
reader is not ev^ conscious of them. It would 
seem ludicrous to measure such automated skills 
at a later point of developnr>ent. In fact, one 
might even predkt that such skills, no longer at 
the level of consciousness, might appear to 
decline on tests which try to measure them. Good 
readers do not reodjetter by letter; they proceed 
by lorger ond larger units, up to and including 
discourse meaning units. 

Learning theory has \6ng held that different 
kinds of learning con take ploce at different 
stoges of learning. Thus behavioral, skill-focused 
learning con be adequate in the early stages of 
reading but should b^ replaced as soon as possible 
by more cognitive strategies which involve higher 
level meanings. For some critics, this means 
!tentences. I would argue that fpr the typical 
cooperative child who will accept the fact that 
certain ckill or odd things must be done in order to 
get to nrwe interesting things, almost any reading 
approach con be successful. Sonr)e children nrray 
be ready to occept such behavioral (letter-sound 
type) instruction earlier or later than others. 
Some sort of diagnostic instrument should be oble 
to predict who such children ore. It seems likely 
that ar>e type of prediction will be based on the 
child's personolity more than on ttie reading tasks 
or on the lor^guoge accesses ttiemselves. 

Porullels to this exist in other areas of 
learning as well. Foreign language learr>ers face 
similar problems. At a given stage in the 
development of the target language, the learner 
experiences different degrees of awareness or 
outomoticity in different relotionships to each 
other. Thus in his communication, a learner at 
onset will be expected to nxiintoin high oworeriess 
of phonology and lexicon which is outooKited and 
therefore less useful to measure at later stages. 

". However much the experts might argue about 
the exact levels of such outomoticity, there is 
general agreement that something like such a 
relationship octuolly exists, and this is the mojor 
point to be mode from the illustration. Any effort 



at assessing learning ability muit be fully aware 
of this ospect of the setting or run the risk of 
nneasuring useless thir^. 

Suggestions for Future Research 

These three basic questions, then, uruie/Ue the 
Instructional Dimensions Study of the etfec t of 
setting on learning. The goal of tfnis aspect of the 
study was rotherprecise, focusing os it did on c^e 
snrwll aspect of the larger notion of context, the 
following dkigrom is only suggestive of the dimen- 
sions in which the effect of context fcould be 
assessed: 

Figure I simply pictures the potential gross 
categories or features which might be noted as 
children learn. Duplicate figures could be 
presented for learning and for teaching, doubling 
ttie dinriensions and realistically noting thot 
teaching ond learning ore not the sanr>e things. 
The IDS examined one cell in the column which 
r)otes physical properties. It did nof attempt to 
see the social or perceptual properties, to disting- 
uish betxivior dimensions or, perhaps most critical 
of all, to determine the interactive, dynomic 
effect of one dinr>ensidn on arK)ther. Being policy 
research, the IDS hod to build on what is known. 
Figure I clearly demonstrates how little this 
amounts to. 
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FIGURE 1 
THE CONTEXT OF LEARNING 

Policy research, deperxJing as it does on 
academic research, must demaruJ a better basis 
from the academic world if its conclusions ore to 
be optional. This paper is not a criticism of policy 
research per se, but of the conditions which 
detract from its effectiveness. Pertvoips one of 
the best outgrowths of policy research is the 
veokness it discovers in that kf>owledge base, 
^erhops or>e of the best services it con perform is 
to point out Ihese weakr>esses. 

The IDS and the follow-up conference for 40 of 
the Title I teact>ers reveoled a number of topics 
for which we rwed to know a great deal more. 

The Effect of Autonomy on Setting . Teacher 
judgnr>ents about tt>e setting of compensatory 
education, specifically mains t ream irtg and pullout 
approaches, ore interesting if rwt explanotory. On 



the whole, the 40 teochers studied favored the 
pullout setting. The reasons used to support 
pulkxit Instruction were varied in quality and 
relevoQce. 

One pro-pullout tcocher explained that teacher 
autononn/ was the. reason she preferred this 
approoch: "Pullout works very well— I wouldn't 
Ixjve it any other way. Mainstreaming couldn't 
work— my kids don't even know when I leave. In 
my program we do our own budgets, sit in on 
hiring interviews, and state our preferences. 
Autonomy is the key." 

Another teacher felt that when the pullout 
teacher takes away her children, she loses control: 
"I don't know exactly what he is doing with ending 
sounds." 

One approach to studying the context of 
learning would be to study the notion of teacher 
autonomy. If the preference for pullout classes 
stems from the teacher's desire to be in control 
and to not have other teacher equals (or superiors) 
in the clossroom, the meaning of the concept of 
puMout is considerably broadened. This is essen- 
tially a study of teacher attitudes, security, and 
locus of control. Do teachers with high quotients 
of autonomy do better jobs in one physical setting 
than another? This is a clear case of support for 
the idea that the properties of context not only 
are broader than the physical dimension but also 
are interactive and interdependent. In short, it is 
necessory to study the process in a dynamic rather 
thon a static framework. 

. ■ ^ 

The Effect of Physjcal Prot>erties on Context . 
Teachers need materials to work with. Using the 
analogy that if a little salt is good, a lot is better, 
Sonne Title I teachers seem to believe that their 
children need more nonbook materials. One of the 
conference teocfiers said: "So nrxiny Title I 
children need manipulatives. It would be 
extremely difficult to do this in a mainstream, 
environment." It is not at all clear why manipula- 
tives or equipnnent such as tape recorders cannot 
be used in a mainstream setting, but this response 
met general agreement. 

On ttie other txind, some teachers objected to 
the overprecision and kxrk-step of nrKiterlals 
geared to Title I children. One objection to the 
pullout regimen had to do with the lock of 
creativity which is perceived to be involved with 
the pulkxjt instruction. Said one teacher, "I like 
to have a more creative atmosphere." 

What is the appropriate relationship of teach- 
ing materials to the Title i context? Is the salt 
anak)gy true? Do compensatory education 
nrxiterials develop a lock-step dullness? This 
aspctt of the physical /socio I /perceptual context 



of teaming has certainly not been clarified. Every 
teacher's convention is flooded with nxinipula- 
tives, plastic gadgets, and other nonbook substi- 
tutes. Do we really hdve a clear idea of their 
value? Is market research adequate? Can it 
replace Jearning theory or avoid it? Since most 
manipulatives ore related to early skill learning, is 
it not possible to compare high-manipulative and 
low-manipulative physical contexts? What effects 
do such contexts hove on the perceptual and social 
properties of context? Can the work on the 
stimulus ctxiracteristics of younger children be 
extended to school -aged learning? (h4elson, 1973; 
Clark, 1978). 

The Effect of Pullout on the Subject Missed 
During ttie Pullout Experience . The hO teachers 
surveyed in the IDS observed that pullout students 
missed physical education, science, social studies, 
leaming centers, art, and music. Oddly enough, 
few teachers,- except for mainstream supporters, 
seemed to lament this loss. It is difficult to know 
what this situation portends for the total learning 
of a child, but it is certainly measurable. Here 
the perceptual and physical properties of context 
come together in a most interesting way, and it 
would be of great benefit to education to learn 
wliat this interaction yields. Careful documenta- 
tion of curriculum in a longitudinal study would be 
desirable. ^ 

The Effect of Pe^r Teaching and Stigmatiza - 
tion. The supporters of mo>^ streaming argue that 
peer teaching does go on and Ihol in 
moinstreamed classes peer stignrKitization is 
greatly reduced: "Some of my pullout children 
become very belligerent. Sonrie kids say they ore 
dumb." 

In response to a question concernin/j how peer 
leaming coukJ take place when those in need were 
pulled out for special instruction, arwther teocher 
responded, "ThereS enough of the rest of the day 
to do the niodeling." One teacher actually 
conceptuolized the role nruxieling issue as one of 
contrasting theories. She put it this way: "One 
approoch is ttxit kids learn best if they hove the 
some. ability. The other is that kids of different 
abilities learn best from each other." This wcs a 
profound, though simple, obiervation. It is abso- 
lutely necessary for research to address this issue. 
We need to know a great deal vnore about the 
effect of Ihc social properties on conceptual and 
perceptual development. lsk> assessment of the 
context of learning will be complete wt'thkout 
taking this issue into consideration. 

Styles of Learning. Many teachers hod opin- 
ions on (or near) the topic of grouping. One 
expressed tier feelings as follows: "The more 
adults you hove in the room, the snnaller the 
group, the better the teaching." Her theory is 
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cleorl/ that small b good and that children leom 
better In small gro^ than In lorge* There is 
little or no evidence to support or reject thb 
net ion. Rekitivel/ little is known about leoming 
5/yle, despite tt^ rather large amount of attention 
given it in education. We know (or think we know) 
SDme things about cultural learning styles 
(fvkivajos sit in circies, etc.) but rekitively little 
about individual, nonsoclall/ determined styles. 
Some research exists on perceptual styles, and 
experience shows us that in judging a work of art, 
some people see shape before color or detail. It 
would seem reospnoble that such perceptual 
plugging-in might be relevant here as well. It 
would seem reasonable to e^^pect research to learn 
how to assess the effect of learning in gr6ups 
versus learning by oneself both cross-culturally 
and individually so that teaching programs might 
adjust to such useful knowledge. 

The Effect of Coordinotive Ability. It ts clear 
that some teachers prefer to be the lone teacher 
in the classroom. Others thrive on teom efforts. 
Little is done in teocher training (or in academic 
research, for that matter) to develop the notion of 
team effort. The term is used, but it is littfe 
more than a slogan. 

Pullout teachers who had experienced the 
mainstream setting compla.n about the lack of 
coordinotion between the regular teacher and the 
compensatory educotion teacher. One teacher 
asked, "How can an outsider know my kids?' It 
remains unclear how this same outsider can know 
her kids any better when the child is pulled but 
rather than ma inst reamed. The real problem 
appeors to be the old "two cooks in the kitchen" 
syndrome. When asked whether or not on aide in 
the regular ckissroom offers a similar threat, one 
teacher responded: "It's hard for two people to 
work in the some room. YouVe got to be cble to 
respect each other. You can't always have your 
own way." Other teachers disagreed, saying that 
a teocher and aide in the some, room did not 
present a "two^cooks" problem. Again, authority 
appears to be on important issue. If pullout 
programs are implemented primarily to avoid the 
'*two cooks" issue, education hod better tdce a 
good look at itself. Surely teochers must learn to 
work together if they pkm to help children fearn 
to work together. More importantly, teocher 
training institutions might be expected to do a 
better job of training teoct^ers in coordinotive 
proctkre, whether with equals or subordinates. 



The Effect of Recordkeeping . When pullout 
instruction is introduced, complications in record- 
keeping seem to develop. 

One of the teochers in the IDS was particularly 
opposed to the increosed amounts of recordkef^p* 



Ing involved in such efforts: "I dont think it's 
worth it— my teacher judgment is just as valuable 
OS a card with x's on it." AiK>ther teacher noted 
that the time spent keeping records kept her from 
interocting with the student: "I feel that I don't 
meet the kids' needs becouse I have to get the 
paperwork for skills work done." This paperwork 
not only involves keeping track of where the 
children are, but It Is also ottochedio accompany* 
ing sets of "skills-hierarchy-materials" associated 
with many pullout programs. Some teochers 
lamented that their children were taking on 
Inordinate amount of time getting through these 
hierarchies and some of them seemed to be.oble 
to read anyway. When asked why they needed to 
teach and test the skills even after the learning 
gestolt hod been accomplished, the teachers 
offered as their only reason that it was useful to 
hove documentation in record form when 
justifying grades and placement to parents, 
principals, and even to the children themselves. 
This rather legally oriented fear needs to be 
further examined. It appears at least possible 
that pullout instruction, requiring more bookkeep- 
ing, con actually detroct from learning even 
though It may protect, the teacher or school. 
Other ways of protecting might be considered if 
learning suffers because of it. Once ogoin, the 
total context of learning must be examined if we 
ore to understand it in its fullest sense. 

Comp<yative Setting Studies. In order to fully 
understand the effect of setting on learning, one 
might expect to be able to measure the some 
learning in different settings. One of the odd 
egocentrtsms of education is that learning is 
directly related to what Is tought. Some 
specialists in language teaching hove begun to 
realize that much more language learning goes on 
outside of classrooms thon inside. The social 
properties noted in Figure I ore the socially, 
recognized events both within and outside the 
school setting. The'setting has been shown to 
affect the way children interpret the utterances 
of others, either literally or nonliterolly. "I see 
someone whose hands are not folded" con be token 
literally, for example, but is unlikely that the 
setting in which this is uttered will permit a 
mature, literal understanding. Setting also 
affects the way children behave and talk (Botes, 
1976). Education Is only beginning to understand 
tfii* dimension, and*it would be useful to know a 
great deal more. Policy research on learning will 
be somewhat handicapped by the lock of basic 
research in this field* , 

Conclusion 

The task of evaluating the setting of learning, 
then, is of considerable complexity. Setting is 
more than plus-or-minus pjoce. For more critical 
than this is to identify wly^t it is that one wishes 
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to mMSure with such precision so that some 
agreement will ensue about What is being' 
measured. Next» one tries to determine whether 
or not this variable really matters. Then orw 
searches for the appropriate time and place to 
mecsure it. Much of v^t we examine when we 
n^ieasure reading ability has no more bearing on a 
child's ability to read than does a driver's ability 
to remember the fact that he is supposed to look 
in the rear view mirror every 10 seconds bear on 
his obility to drive a car. In driver's trainingi one 
is taught to look into the rear view mirror every 
10 seconds, but to be consciously aware of doing 
so could eosily lead to a traffic disaster. An early 
learning skill, however useful, is not necessarily a 
good measure of overall ability or competence. 

At this time, policy research will do well to 
demand that academic research provide a better 
basis for determining the effect, of setting on 
learning. We need to define what it is that we 
mean by setting, set its measurement within 
appropriate content theory models, place it within 
appropriate crtd well-defined learning theory 
moders, and know its quoHtotive aspects before 
we attempt any kind of quantitative^ studies. The 
teachers surveyed in the IDS seemed to have a 
feel for these problems even though the>^ were 
never articulated in quite this way. We need to 
see learning in its natural setting. Even policy 
research needs to identify the theory upon which 
it !s based in order to avoid mixing theories and 
calling them the sanne thing. We need to identify 



a measurement variable In relationship to the 
effect of~many other contributing variables. The 
teachers themselves suggested^ch obvious vari- 
ables as classroom size and ottroctlveness and 
teocher concern. One could suggest differences In 
culture, age, sex, ethnicity and socioeconomic- 
status. 



We might begin by following the lead offered 
by researchers in microanalysis (see, for example, 
Kendon et al., 1975; Erickson, 1975; Sheflen, 
1973). In order to arrive at a description of how 
children nrKike sense of the world, it is necessary 
to examine in detail what these children are doing 
and saying.' Just as people "style switch," 
depending on what they perceive to be required of 
a situation (Blom and Gumperz, 1972), so students 
and teachers act differently in tijie classroom, 
depending on the situation In which they are 
engaged* If sgch variability tak,es| place (gnd it 
does), it must signal something very important 
about learning. In any case, a great deal of 
careful observational and ethnographic work will 
need to precede the counting which characterizes 
much educational evaluation today. To assess the 
effect of setting on learning, we will need to 
expand the dimensions of the topic to determine 
what we mean by setting, what really nxitters in 
terms of rneasuring, and where or at what point on 
the learning continuum it is best to observe it. 
Meanwhile, policy decisions will have to be oKide 
on less than adequate grounds. 
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Qiapter V. Planning,. Oiganization, and Management 

ASPE<^^OF PLANNING, ORGANIZATION, 
MANAGEMENT OF SELECTED READING PROGRAMS 

I Morton Botel 
University of Pennsylvania 
Philadelphia, Pennsylvania 



Locol Schools Make a Difference 

The focus of thb report- of the Instructional 
Dimensions Study (IDS) Conference is on ospects 
of pkmning, organization, and management of the 
reoding program from the perspectives of the 40 
conferees and from related research literature. / 

Conferees were . selected teachers in 
compensatory' e<iucat ion programs of the IDS. 
ITk^Y shared their experiences and insights on the 
plonning, organizotion, and management of their 
school district, school, and classroom instructional 
progroms in reading. 

The research , on teacher effectiveness (Heath 
ond Nfeison, 1974) has not documented a single 
stylistic teacher skill vvhich con clearly be 
associated with student achievement In reading. 
Nor hove major mett>odological studies shown the 
value of cine reading mettml over another as 
hoving great slgrfflconce (Oylcstra, 1968; House et 
aU 1977). There is, however, consideroble 
empirical evidence tfibt certain variables in 
planning, management, and organization can 
enhance teocher' ^fectiveness in advancing- 
redding achievement. These variables are a 
bolonced reading/language arts program, a simple 
monbgement system that irivohm more holistic, 
fynctional testing, strong principal leodersh.ip, and 
parent Involvement. 

The ttiesis to be oKplored in this report b that 
local schools do make a difference in producing 
higher ochlevement to reoding, but the difference 
eeefW ^ be more a result of nriotivational 
vcrkibleft and of planning^ orsfonization, and 
mohbgement of the total reodlng/comnHimications 
arts envirofWnent than of stylistic variables of 
fepchers or of tlie reading Imethod" used. 

gfflfements of Conferees 

The 6 to 7 hours of dlologue with the 40 
ebhf^^ees provided Insights into tfw contributions 
Mi blocks fty learning of the leadership staff of 



their schools, into their own proctices and prefer*^ 
ences, and into the growing role of parents. 

The conferees were most critical of reading 
goals set forth from the central adninistration. 
They belief the goals tend to be too brood and 
/abstract. Further, lihe> thought the administro* 
tion tends ta view accountability from the top 
down, expressing expected perfornrxince of stu- 
dents in terms like "Ho improve each student's 
achievement in reading each year by at least one 
year on the xyz test." 

Typically, they said, the means for implement- 
ing the nrain godls are specif lied by tests, manage- 
ment by objectives schemes and by texts and 
other resourceis that hove highly specifiefd skill 
sequences. These are chosen by the top of the 
school administration hierarchy with Uttle teacher 
input, although there Is* a small but increasing 
amount of teacher input in the cose of choosing 
textual materials. It was the consensu^ of these 
teochers ttxit the districtwide management and 
testing schemes result in a heavy burden of 
nonproductive overtesting okI paperwork. 

They also noted that such experiences as 
reading to children, self-selected reading, and oral 
. and written composltion^ore typically not found in 
the statements of main goals or in specif Icatlon of 
means for ochieving them. 

The conferees consid^MI the principal's lead- 
ership very Important. While only about half of 
the conferees considered their principals to be 
strong, they all ogreed that principals who took 
active interest and leodership in planning, nrKxiI- 
\toring, and conferring with teachers \elevated the 
olity of reeding instruction. 

\The teachers indicated by their descriptions of 
tM^ work that they were responsive and f lexible, 
aware of the indivkfcial differences and needs of 
childrbu They felt free to niodify and of ten to 
ignore management and test dota in favor of their 
own observotion of chlMren in learning settings. 
They reported spending 3 to 4 hours per day to 
prepare for their ckmes. Despite the lock of 



dhtrlct-level orticulatlon of mjch critical learning 
tt^tt-leoces OS reading to children, self-eelected 
recdli^ and coniposing, the teachers typically 
Dufit them into their programs. Moreover, they 
tended to coordinate their work with that of the 
regular classroom teachers and their aides. 

^ The teachers noted that parents ore increas- 
ingly Involved In odvisory and aide functions and 
in helping their t*lldren at home in reoding or^d 
arithmetic. They reported that their schools are 
sending appropriate materials honrie and instruct- 
ing parents in their use. 

Inferences from Conferee Statements for 
Improvement ot Keadinq Prooroms " 

^Four main inferences can be drawn from the 
obove observations of the conferees for improving 
the planning, organization, and management of 
school reading programs. 

First, the district monogement scheme should 
not be limited to abstroct gools and/or to stating 
expected scores on tests. It should articulate the 
•"^'S^ta and practices of teachers who provide 
children with a balance of productive holistic 
reodin^languoge arts experiences involving oral 
literature, self-selected reading* and oral and 
written bompositlon as well as systematic skill 
sequencer. ' 

Second, \the district nrKmagement schenr>e for 
^ lonitoring mastery of basic decoding/compre- 
heiision skills>yshould be simplified, making use of 
more holistic W functional measures of reading 
conT(>etence, tkis cutting down the seemingly 
endless and unptoductive paperwork and record- 
keeping of typic^ management plans. It should 
assert the signifit^e of responsive/diagnostic 
teaching as the ^poin evaluative approach to 
meeting children^ looming needs. This is In foct 
what good teachers vdo, but it is given littl^ 
credibility in district plans. T 

Th^rd, the principal should be a strong manogeri 
of the school reading program by artlcukiting the\ 
structure and nrxinagement of the program as \ 
indicated above and bf providing for dialogue with \ 
and Gmong the staff and parents. \ 

Hnofly, parents should be encouroged to be- ^ 
come partners with teachers in \the direct educa- 
tion of their\ children in the basic skills, and 
schools shouki help them find the means for doing 
so. 




Support for These Inferences from Research 

. This section of the report will examine the 
research support for the inferences derived from 
conferee observations. It will suggest that a 



bo onced program of readlng/kmguage arts In- 
volves provkling students with four critical exper- 
iences, rother than a particular best method, that 
competency testing should be more holistic rather 
than atomistic, that principal leadership con hove 
a ^rong influence on reading instruction, and that 
a literate environment at home is a powerful 
variable in developing a competent reader. 

A More Fu nctional (Holistic) Approoch to Teach- 
ing; A balancing ot Keadino/Lanouoae Art s 
txperiences — ^ 

The conferees agreed that it would be helpful 
if the district goals and means delineated and 
supported a balance of all of the critical 
reading/language arts experiences, rather than 
concentrating only on those that related to 
specific sii>skill sequences in decoding and com- 
prehension. In addition to working with structured 
sequences or skills, the conferees generally pro- 
vided regular times for children to hear stories 
and poems, to have them respond in ways that 
stimulated o^al and written languoge and imogina- 
tion. They also provided time for their children to 
choose books and read them silently. They 
regularly enabled children to dictate and write 
norratives and poems. ^ It is\ important to 
remember that they did so in the absence of 
districtwide policy encouraging these practices. 
Many colleagues of the conferees may be influ- 
enced by the lock of stoted district policy to think 
that experiences other ihon basals\and other 
hierarchically organized programs are purely for 
enrichment^ and are theref<We not Ixisic*^ skills. 

, The evidence indicates tfherwise. Each of the 
above experiences is critical to success in reading 
because each contributes to bchievement in read- 
ing as well as to the folrmation of positive 
attitudes, according to a review of the research 
by Botel (1977), who defined tf^ as follows: 

\ 

Critical Experience I: Retoondinq to Litero- 
tyre. Mudents experience literqtore by hearing It, 
reading It, or viewing it and ore encouraged to 
respond to it through diak>gue,\ writing, simula- 
tions, and the other expressive <nts. 



Critica l Experience 2; Sustained Silent Reod- 
ing or :>eit -5elected BoS^ $tudents choose 
books, periodicals, etc., from a wi<i^e selection and 
read them without interruption at their own pace 
^ond in their own way. \ 

\ Critical Experience 3: Composihg, Oral and 
Written. Students dictate or write something ot 
their own each doy. 

Critical Experience 4t Investioating and Mos- 
tering Languoge Patterns . Students study system- 
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.otic sequences of decoding/comprehension octivi* 
ties at their instructional levels through both 
problem solving and practice and c?; U! approaches. 

• A More Functional (Holistic) =Ag y/rugch to Testing 
ond Recordkeeping '"^ 

Half or more of conferees found, the 
.testing and recordtejepsDg in their schools to be ; 
cumbrous and l»'^iie£s^v^^- Without exception/ / 
however, they r^; ort«;J that they relied mainly on / 
their own observation) and jiidgment to provide for / 
the special needs of each child. An increasing / 
number of schools hove recently adopted testing, / 
management, and recordkeeping systems rthat/; 
focus almost exclusively on subskills. In iuch\ [ 
schools, reading is analyzed into subskills ^^of ! \ 
sound, structure, and; meaning, each of these 1 
.isolated fragments hdving a test and ledrningff^ 
routine associated with it. Some mgnagefherit..^ 
schemes identify hundreds of these subskills.' ; 

^] 

The negative effects of^^ch^n^ySTfemsi are 
many. The schemes define a reading curricMlum 
as the sum of these pieces; they demand an 
inordinate amount of time for testing and record- 
ing children's performance; they distract teachers 
from the balance children need of the critical 
reading/language arts experiences. 

In the past few months, the hkitlonal Council 
Teachers of English (NCTE) and International 
i^cciding Aj^ociation (IRA) have spoken out strong- 
ly against such excessive focus, on testing and 
subskills. From the perspective of these two 
professional organizations, the effects hove been 
to diminish the student's comprehensive ability to 
read and write/ to narrow and to dehumanize the 
curriculum, and to dictate teacher style. These 
groups urge teachers to ^teoch from a variety of 
perspectives and to use a variety of learning 
- routines. What they disapprove of is trying to 
measure formally, using either standardized or 
criterion-referenced tests, the innumerable per- 
spectives of meaning as though they hod strong 
diagnostic value. In short, there seems to be a 
different conceptual framework for instruction 
* and for formal testing. 

Nk)w, to the issue of schooLvide testing on 
standardized and criterion-referencecl measures. 
Which of ttie many perspectives suggested by this 
taxonomy can be monitorejd by district- or school- 
wide tests? 

Before deoling with this issue, it ought to be 
made clear that the responsive teacher, who is 
aware of t^>e perspectives of meaning and struc- 
ture and who knows routines for engoging students 
in thinking about them, is also constantly evaluat- 
ing inforrnally how welf students are dealing with 




these ideas. In this sense teaching and evaluating 
ore two sides of the some coin. 

Shoijld standardized and criterion-referenced 
tests try to evaluate each of the perspectives of 
nrieoffing and structure suggested by the dimen- 
sions and aspects of a comprehensive curriculum 
such OS the one appended? <The answer must be no 
for several reasons: cost effect ivi?r'0-v:^ tr^/ inden- 
tation of the curriculum, and unre5:>;l>irf :y. Admin^ 
istering tests tixit are extensive ei»t'::9h to deal 
separ<]tely with all the important aspects of 
meaning and structure would be prohibitively 
expensive and time consuming. On the other 
hand, if we simply choose the aspects we like or 
select them randomly, we run the usual risk that 
the curriculum itself will follow from the selec- 
tion, and a comprehensive program will have to 
shrink. 

In terms of fragmentation, the nature' of tests 
is such that it suggests to some that a curriculum 
is the sum of its elements. In fact, learning is a 
function of understanding relationships and inter- 
actions, of analyzing and reorganizing content, 
not of compiling and mastering a series of 
discrete elements. Therefore, even if it were 
possible and cost e.ffective to test everything that 
a curriculum embraces, we might be misled into 
thinking that perforrpance on separate items 
represented high-level thinking skills rather the ♦ 
memory. 

In terms of reliability, all the evidence on 
comprehension subskills indicates that our present 
measurement of them with standardized or crite- 
rion-referenced tests is not reliable enough for 
individual or group diagnosis. There are two 
general conclusions from all correlational studies 
(there are no experimental studies of this ques- 
tion) of the distinctiveness and hierarchical nature 
of measurable comprehension subskills of reading. 

First, there are between one and four signifi- 
cant foe tors in comprehension, according to sev- 
eral reanolyses of Davis's (\969) data (Thorndike, 
1973; Speoritt, 1972). According to Thorndike,- 
80-90% of the variance in the Davis studies of 
components of comprehension is accounted for by 
vocabulary and the remainder by two or possibly 
three foctors. According to Spearitt, ". . . present . 
types of reading comprehension tests, as distinct 
from word knowledge tests, largely measure one 
basic ability corresponding to the label of reoson- 
ing in reading" (Spearitt, 1972, p. 1 10). 

Second, there is no statistical evidence sup- 
porting o hierarchical order for sequencing com- 
prehension instruction (Dav[is, 1 972, p. 1 72). 

The logical and comprehensive (taxonomic) 
analysis of perspectives of reading, then, yields 
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mqiy downs trf pmpHetivM. Tht stotbttcol 
onoljjto randm m trajor feet or qn^ bot%irMn onp 
and fhroe^ofhori. Tho Inf oroncot of thoM f qcts 
f or tho rote jrf Ibrmol tofft of c onpr o hai n lon ore 
cteor. The rlchnoit and divorsltx of con«>rehan- 
slon cannot be described by subtests. Tests con 
provide 0 global estimate of general conprehen- 
slon, but responsive imoglnotivi teoching is the 
only productive way to know how students ore 
thinking.- ; 

Following the suggestion^ mode above for 
dist^krtwMe testing wouki be cost effective, 
reducing the time end nnoney for testing and 
recordkeeping to less than 5% of what many 
school systems ore presently using. At the same 
■ be more relidble and 

therefore more informative. Educators could then 
emphosize the continuous process of developing a 
comprehensive instructional program with its 
many instructional perspectives and its countless 
opportunities for responsive/diagnostic teaching. 

The Principal as Redder 

^ The conferees, whether they regarded their 
principals as effective leaders or not, agreed that 
a strong principal could be most influential in 
helping develop o strong reading program. 

Two U.S. Office of Education studies yielded 
support of the conferees* observations (IMcstra, 
I968J Abt Associates, Inc., I977X These studies 
<VKilyzed the effectiveness of various combina- 
tions of published primary reading curricula. In 
both studies the major finding was that local 
schools moke a differertce-thot labels of method 
or model moke small contributions to ochievement 
compared with the uniqu^tess of individual 
schools, neighborhoods, and families. 

n on the . 1 9i58 report, Carroll and 

Choll ( 1 975) emphasize the principal's imp<^rt«K:e. 

One of the more interesting and illuminating 
V^JSSPJ^ 'J-S- Office of Education 
(USOE) Cooperative Reading Studies was that 
some schools and school systems hod 
consistently better results than otiiers, even 
when the types of communities. were similar^ 
and when similar methods and materials were 
used. The chief factor t at seemed to be 
responsible for the superior results in these 
-schools'was the onount of interest and atten- 
tion given to the organization of the readng 
program by the school odministrator. Teach- 
ers of reading need understanding and encour- 
agement from their superiors— supervisors, 
principals, school superintendents, and school . 
board members. They need to work in a 
climate that supports and rewards their 
efforts, gives them help when they falter, and 



ollows them freedom to try out new 
jwooches that seem reasonable to them, 
(p. 23) 

Parent Involvement 

Conferees spoke of the growing involvement of 
parents In helping their children learn how to 
read. They reported a recent increase in the 
number_of workshops for parents and in the ^ 
number of helpful materkils that ore routinelf^ 
sent home. <^ 

n 

^ Considerable research has shown that one of 
^the main vcfiridbles in reading achievement is the 
"literate environment'' at home. Children yAyo ' 
come from an environment in which they ore reod 
to and In which they are encouraged to read on 
their own become n>ore school-wise, bo6k-wise, 
and test-wlse (Thomdike, 1973). Several studies 
hove verified the signifkrance of parent involve- 
ment in reading at the preschool and later stages 
O-evenstein, 1975; Sckamoto, 1975; Sprlgle, 1972; 
Chomsky, 1971, l972;Durkin, iml « V ^» 

I ^ 

Carroll and Chall (1975) sfrongly urge that 
par^ts ploy a stronger role in helping their 
children learn to read: 

... we feel that parents should be encouraged 
to give their children help in reoding before 
(and after) they enter school-by reading to" 
them, by teaching them such things as the 
names of the letters of the alphabet and the 
sounds of the letters^ and by helping them 
learn to recognize o small vocabulary of 
words. Parents should give it only if a child 
seems to show an interest in letters and words, 
and in reading generolly-interest that parents 
. con promote by showing that reading is a 
pleasurable and meaningful activity. We ore 
aware that, on the basis of widely held but 
poorjy supported views in the reading profes- 
sion, reodBng teachers have frequently discour- 
<*ged poribnts from giving help in reading on the 
grounds thot it would "confuse" the child and 
produce conflict with t^jching in school. We 
believe this is unlikely to happen, (p. 19) 

Summary 

In short, the Instructional Dimensions Study 
conferees' perceptions of what Is productive for 
children's reading competence corresponds to 
inferences from research. 

In the conferees' view, it was important in 
their programs to have regular periods of reading 
to pupils, to provide time for self-selected reading 
and self-selected writings as well o$ for the study 
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of specific decoding and comprehension skills. 
They believed that there was too much testing and 
unproductive recordkeeping in most dstrictwide 
management s/stemsi and they relied mainly on 
their own judgment in meeting the needs of pupils. 
They thought thqt strong supportive principals 
mode on important difference in the morale and 
quality of the progronri. They generally urged 
parent involvement in helping their children learn 
to redd. 

With respect to these same variables, the 
research literature suggests thct:. 

(I) Children would benefit from a system- 
atic yet balanced program of four criti- 
cal experiences in reading/language arts. 
They are: 

0. doily opportunity to hear and to 
respond to o variety of imaginative 
prose and poetry selections', 

b. daWy opportunities to select books 
and read silently at their own pace; 

c. daily opportunities to dictate and 
" . write their own thoughts and feel- 

|ngsj and 

d. daily opportunities to investigate 
and master the functional skiils of - 
decoding in the search for meaning. 

(2) The" management and monitoring pro- 
gram needs to rely on more simple. 



reliable, and cost-effective functional 
reading tests, and on informed teacher 
judgment. Such management would min* 
imize the excessive focus on subskills 
and its concomitant time-consuming 
recordkeeping, and would provide more 
time for direct instruction. 

(3) Strong principal leadership is associated 
with high achievement in reading. Major 
studies to date do not support one meth- 
od over another as a major variable in 
achievement. On the other hand, differ- 
ences among schools that use the some 
method ore profoundly significant. The 
well-organized, knowledgeable, suppO;-t- 
ive, and enthusiastic principal seems 1o 
moke the difference. 

(4) Informed parent involvement results in 
higher reading achievements No variable 
is more consistently associated with 
achievement than the quality of the 
literate environment at home. Experi- 
ments have validated this regularly 
observed relationship. Where parents 
hove been helped to establish a more 
literate environment, their children's 
reading achievement has been enhanced. 

Clearly, teachers perceptions correspond to 
the findings of research in the iTKitter of 
improving the reading achievement of children. 
What is missing very often is the understanding of 
and commitment to these ideas by the leadership 
of our schools. 
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REPORT AND COMMENTS ON NIE TEACHER WORKSHOPS. 
INSTRUCTIONAL DIMENSIONS STUDY 



David Hawkins 
University of CoJorodo 
Boulder, Colorodo 



I would like in this paper to turn ottention to 
the substantive aspects of the NIE Instructional 
Dimensions Study— in the very inc6rTV>lete form so 
for known to me— <ind to my personal records, and 
impressions of the panels I participated in, 
entitled "Planning, Organization, and Management 
of Compensatory Education," during the April 27- 
28 conference. 

General Context 

Ours is 0 field in which th#» main problem is 
. not to seek more information, but rather to know 
how to redesign the channels of information 
flow— by successive approximotion^-so as increos- 
ingly to admit what is more essential for practical 
or theoretical purposes ond to filter out what is 
inessential. 

My concern in this paper is not the study 
itself— which I hardly as yet know— nor the 
teachers* conference itself— from which I hove o 
crowd^^f somewhat contradictory and in. any case 
very interesting impressions— but the development 
of some possible and plausible relations between 
the two which might both benefit the 
interpretation of data from the fornDer and moke 
possible some reconstruction of the channels 
through which other relevant infornrxition might 
be obtained. 

The general impression I gathered from the 
teochers I observed is that the dimensions of 
teacher concern with the study were in general 
only k>osely rekited to triose evolved tor purposes 
of research and sometimes were almost 
orthogonal to the latter. This applies particularly 
^o the teochers' discussion of planning. We 
learned from all that the ossumption of stability 
was kirgely justified; there were indeed program 
changes over the past 2 years in some coses, but 
the chonges were not of o kind to perturb the 
teochers' sense of confidence or to be beyond the 
ingenious remedies they in some coses invented. 
The essential stability was that of the teochers 
themselves, on the whole an experienced group. 
This impression was sustained in oil the later 
group discussions. 



Some New Voriobles 

In the first of the four groups, we experienced 
o change of style in the latter port of the 
discussion, one that suggested the order that we 
followed in loter groups. The pivotal questions 
hod to do with planning. There, were preliminary 
comments that rtKide evident o diversity of 
planning histories with respect to the -kinds of 
programs and the kind and degree of district ond 
teacher involvement; what brought the meeting to 
a distinctly higher level of liveliness was the 
opportunity to focus on teachers' own perceptions 
of their essential role, as teachers, in planning for 
the children they taught.. 

The teochers spQke enthusiastically of their 
reol job— making children comfortable; making 
. them want to come to school; taking time from a 
prescribed lesson to discuss a recent hurricane in . 
the neighborhood and find out more about such 
things; replacing o narrow "diagnostic- 
prescriptive" impasse with specific children by 
materials improvised by the teacher herself in the 
light of a quite personol diagnosis. A general 
summary— confirmed when it was mentioned in * 
later groups— was thol vwhere teachers were 
committed to following the pattern of some 
specifically odopted curricular '^ckoge," they 
exercised substantial fri^om and Judgment in 
interpolating materials from other sources, 
including those they mode themselves or asked 
parent groups' help in manufacturing. 

The some sense of independent mind and 
judgment was apparent when we touched on the 
nnatter of assignment of children to the Title I 
category. Teochers started with the test, but 
they felt fully confident in their ability to modify 
the indication of test scores in the light of 
personal judgment about individual children— 
whether or to what .extent they carried this 
through being only o matter of the degree of 
flexibility accorded ^ them. They got more 
relevant infornrution from observing children take 
the test, in some cases, tSan from the score itself. 
Some children ore conspicuously test-shy, others 
are test-wise without the abilities their scores 
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Imply; entering 1st graders hove often not learned 
the gqme. 

I should not like these observations to be 
Interpreted as evidence that our teachers 
belonged ta a class af rebels, as advoc(9es or 
practitioners af radically nonstandard teaching 
nxKies such OS "open education," etc. With twa^ 
- three exceptions, they did not seem ta be. They 
were mostly stayers who accepted their present- 
day school world as given; within it, in one way qr 
another, they functioned with considerable com- 
petence. 

A significant turnaround in the later discus- 
sions come with a question asked by my ca- 
reporter, Morton Botel. This concerned teachers' 
actual and preferred priorities with respect ta 
their allocation of children's time between various 
possible uses of the total allotted ta reading 
instructic His report discusses, the specific 
responses we received. Generally speaking, the 
teachers in the three groups were strongly in 
fovar of giving top priority to free' reading and 
related activities calculated ta involve children in 
reading as a personal interest und commitment, 
along with decoding practice. On the other hand, 
some confessed they did not fallow this belief in 
practice, primarily because af time pressures— in 
effect, the routines of decoding instruction hod a 
higher priority. In the discussion, Morton Botel 
asked whether this kind of activity was in their 
district plans, and lypicoll/ it was not. 

Unfortunately, time pressures were such that I 
was able in only .one group to ask the some sort af 
question about time spent in classroom moth ar - 
"nrKJth lobs." I receives! a similar reply. From 
observation elsewhere, I would conjecture that top 
official priority is typically given to work with 
narrow skills in the written, workbook mode, and 
that a more investigative style af work^ far 
instance with "three-dimensional materials"— geo- 
boards, cuisenaire rods, poker chips, geometrical 
tUes, cubes and multibose blocks, and bolonces, to 
name only the most stylized— is relatively 
unknown or unused. Even less likely is the use of 
practical arithmetic and geometry in measuring, 
mopping, model building, ar recordkeeping. I 
would conjecture that any teachers* tendencies 
toward exploration and use af such materials nrKiy 
be inhibited by unfamillority ar by the absence in 
district or school plans af ony recognition af their 
value, either for children as a whale or far those 
in the Title I category. 

I should like to propose here a rather general 
hypothesis about teaching and planning in gener- 
al, and Title I in particular. I shall not limit the 
hypothesis to planning far Title I children; I regard 
most elementary school teaching af reading and 
moth OS essentially in the some category. 



Hypothesis ; In stating this hypothesis, I shall 
use on analogy that I owe to Frances' Hawkins, an 
experienced therapeutic teacher af young chil- 
dren, token from her book The Logic of Action 
(New York: Pantheon-Random House, 1974, pp. 
viii-x). The analogy: Oxygen given to save the 
lives of premature infants was far long being 
given in what turned out ta be excessive amounts. 
The excess caused blindness and other brain 
damage. Such results, however, are characteristic 
products af lack of oxygen, af anoxia, and this 
fact seemed at first to indicate a need far mare 
oxygen rather than less. After several years af 
hospital research it was finally discavered that a 
high oxygen pressure damaged the delicate lung 
tissues and thus, after a time, decreased their 
absorptive capacity for oxygen, causing retrolen- 
tol fibroplasia, damage ta the Inte-stoge embry- 
ology of the broin, notably that af its optic nerve. 
I quote Fronces Howkins' use of the anology: 

Faced with the foilure of children in our 
schools, their foilure to learn well olong the 
track which school has paved for them, where 
are the school doctors (not from the outside) 
who will soy, with such informed ond per- 
sistent conviction, "It is something we ore 
doing to them, our schools ore doing toTRem?" 
Ihsteod of seeing o child's foilure as o response 
to our doing, to our foilure, it becomes o 
"leorning disability," o "behovior problem," ond 
we ore exoneroted. 

Very much of whot children need for their 
leorning must, come directly ond indirectly 
from odults. As oxygen to the lungs, it must 
be rend led for them and tronsmitted to them. 
Foc^d with foHure in the process we respond 
too easily by increasing the intensity of the 
efforts which hove olreody foiled, ond in doing 
so we moy block the very chonnols through 
which children go in knowledge > ond 
understonding. . . .The mput we offer is 
needed, yet not assimiloted. 

Title I children ore predictobly (for whotever 
reason) not likely to ossimilote well the stondord 
fore of eorly schooling. Under these conditions 
increased drill, increased emphosis on decoding 
ond connpetency skills, os distinguished from the 
contextuol ospects which moke these skills 
desiroble and desired by children themselves, con 
be. like excessive oxygen to the lungs, o theropeu- 
tic ogent tronsformed into o poison, the unwitting 
couse of that which it is oimed to cure. 

r refer to this generol stotement os o hypotrn 
esis, which from the NIE reseorch perspective it 
jiiust be— olthough I believe its correctness is a 
guiding commitment omong the most successful of 
our teochers. It runs counter to mony present-doy 
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' tendehctes toward commercial V>ckagingr of 
detolled ourriculo and l4nplies insteod thqt 
«.toochers ore or should be dble to odopt and to 
create an ambience in which children's curiosities 
ore aroused and supported! This Implies no lode of 
attention to the mechanics of "skill," but rather a 
context In which children ore motivated to prac- 
tice these skills and to learn them along with 
things of greater intrinsic value. 

In both reading and mathematics these consid- 
erations of background and ambience ore of vital 
importance. Since my own work has been 
primarily in the latter domain, let me indicate in 
more detail whot I see as being involved. Even 
before starting school, almost oil children hove a 
• wide ronge of rnathemcticol competencies and 
understanding related to their preschool and out- 
of-school lives; in contexts thot Invite their close 
attention, they con communicate verbally their 
awareness and, grasp of a wide range of bosic Ideos 
of number, form, and order. But this body of 
fluent understanding is not where we typically 
start in school "mathematics." School fTwthe- 
nrKJtics is focused on the mastery of a code, itself 
on incomplete and abbreviated writteri language, 
often bewilder ingly detached from the context in 
which children dcquire fluency of early math*.^ 
moticol understanding. Reliance on prepackaged 
"curricula," even more than the less detailed 
textbook approach of the post, necessarily ign^v »s 
all elements of context which establish continuity 
with earlier or concorr^ntinformal learning. The 
little-step-by-step a|:proach of the workbook, the 
diagnostic test, and the prescriptive loop back 
through exerci^s constitute an unwitting 
conspiracy to cause the very failure they purport 
to cure* 

I say all of thif with fvH appreciation of the 
ultimote importance of the step-by-step charocv>r 
of formalized mathemv:i1 ics iiuAf. Even in its 
tnosi elenDentory branches, mathematics is.knitrcd 
together into an intellfg^i^fe system by €f>mponcnts 
of 0 detailed logic which is the final touchstone. 
But no one grows in fluency and mastery by pa-^ fng 
attention only to those components. The nwe 
long-range elemenfs— those of practical experi- 
ence. Imagery, of onolosjy of .ntuition— ore eauoC- 
ly vital to children's learning. 

The above hypothesis is not in "tr:stable" form. 
It b 0 coixiitloninq hypothesii, a directive frame- 
work for more detc&iled formulation. I hove 
odequote reason to believe that vhe porticiponts in 
the conference would go all the wc?v ir agreeing 
with my i^^rmulotion. 1 would surmise that a good 
nrxjny of thern hove not hod the opportunity to 
sunple ocross a range of learning situotions much 
wider than the e that schools normally provide— 
which is rot very gr,eat. Nevertheless, * believe 
they would go port way. Tf>ay would move beyond 



the dominant views expressed in state and district 
policy and planning. Their stability os profession^ 
als who do experience the constraints I hove 
objected to creates a research opportunity. 

Possible Research Opportunities 

The opportunity for research exists in the 
rather wide gap between stondord demographic 
research and that bosed on attempts to create 
learning environments that ore demogrophicolly 
too rare to be available for farnrxil investigation. 
Attempts to bridge this gap by experimental 
designs of the kind recently popular ore signifi- 
cantly unimpressive. I need not refer to recent 
controversy over the comporison-of "models." The 
essential point is that the time scale Vequi red for 
the appearance of any kind of program worth 
studying is teng cornpored to what most research 
designs allow. Interesting school situations ore 
the product of institutional end personal history, 
not of short-term engineering. 

"Stability,-' one of the IDS criteria, con help 
create interesting 2ichool situations. There has 
been time allowed for teachers to settle in, ^o 
invent ways of working with children, to bring 
their background expertise to bear, to ccsrve out 
for themselves wme domoin in which they hove 
relative freedom in tlieir planning and day-to-day 
decisionnDoking. 

Suppose one chose the top iO%.and the bottom" 
fO% of classes, measured by overoge goircs in tho 
study's test scores One would then iook for 
controsting charocteristics of the two groups of 
programs thus selected, iwticulorly with respect 
to more detailed definition of those rhorocteris- 
tics PDentione^ obov^notobiy the chr -octeristics 
of teachers' participation in planning at various 
levels and on various time scales, the constraints 
they experience, and ih^lr perception of the 
relative importance of yoriocis aspects of vheir 
program. 

As I havcf alr.eody stoted^ I would be surprised 
if schools and teachers selected by such a 10% 
criteria'! would differ radically from the majorit;/ 
in most surface ospects. Even with due recwrd for 
regression and for the narrow sampling ?f «sduca- 
tionolly significant learning represented by 
stondcirdized tests, I would, however, expect that 
some valuable rei&ults could cor>:e from such a 
secorid roattHL 

AAost kirge-scoie educational research theCit I 
am forr.Clior with starts with the attempt to 
mec^iire and relate predefined and inexpensively 
sonr^led voriobles that are iiuspected or cloimecv 
to hove relevance, and the typical outcome is one 
of relativ<»ly minor differences in averoge 
outcomes. It seems to me thot such investigations 
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con be signmcant only as leoding to a second or 
third cycle In which the primary value accorded to 
earlier re«ults is the redefinition of what is looked 
for in Ihe fallov^ng cycle* — _ 

Let me illustrate this possible redefinition by 
, an example of one af the matters discussed in the 
conference and highlighted in its preliminary 
report, the lack of conspicuous difference 
between ''mainstream" and "puHout" patterns of 
association between classroom teochers and 
specialist teochers. There appears to be a wide 
variety within each of these patterns, and this has 
a great deal to do with the degree and content of 
communication between the teochers involved. It 
is possible to have a "pullout" pattern in which 
classroom and specialist teachers supplement each 
ethers' perceptions of the needs of individual 
children, having seen them in different environ- 
ments. On the other hand, it is possible to 
envision a 'Vnoinstreom" pattern in which there is 
little or no such communication, where the 
visiting specialist is in effect a total "puMout." 

' Rather plausibly, there is a definition of 
alternative patterns in such coses that should take 
a bigger bite of the variance in outcome measures 
than the one initially adopted. The information is 
likely to be more expensive per unit to obtain, 
which argues for a reduction in the scale of 
research— but the infornxation does not seern to be 
inherently difficult to quantify through a com- 
bined use of interviews, questionnaires, and 
directed observations. 

What I am proposing is a shift from evaluative 
research to elucidative research. Thc^ one looks 
for association between input and outpOt vdriobles 
already defined and mokes comparisons between 
two or more alternative patterns of schooling. 
The other starts with significont differences in 
eduMtionql outcomes and tries to define essential 
differences in treatment. This nneans that the 
empii\ical investigation is relatively open, guided 
by hunches, by analogies, by extrapolation of 
theory, as well as by known and obvious require- 
ments. 

But the contrast between evaluative and 
elucidative should be for interaction, not for 
separation. To define new variables of input and 
outcome that ore more strongly related to ea3F 
other and can be understood within a conceptual 
organization is also to learn to define better 
channels for -evaluating by this new evidence, for 
further elucidation, etc. 

Having suggested one example, I would like to 
make a series of suggestions. Since I hove by no 
means fully grasped the framework or content of 
the study, I must apologize for what will undoubt- 
edly be seen as a lock of contoct with the kinds of 
infornrxition it already contains. 



Let me first imqke a specific suggestion con- 
cerning future outcome measures. In any 
subsample* selected for further empirical study, 
one should somehow obtain "mlni-longitudlnor 
data xi children's kiter f?erformance in school- 
test data, teachers'^ judgments on Individual 
children's general welfare and promise in school, 
absenteeism, etc. Locking a 20-year longitudinal 
study of educational outcomes, we could very well 
use 0 second year, and a third, especially when 
test measures con be qualified by teacher 
judgments, etc. There may well be other input- 
outcome measures to be used. Indirectly but 
perhaps partially reloted^-such as, for example, 
evidence concerning continuing stability, teachers' 
' morale, etc. All the new measures would seem to 
me to be relevant as follows: 

I. Opportunity. As I understand this composite 
measure, it is lacking in any qualitative dinnen- 
sions. "Overlap" relies exclusively on tests as 
outcome measures. If other outconne measures . 
ore odded, the educationally spurious value of. 
"overlap" would presumably be reduced, as it 
would on tests explicitly designed to ovoid 
thoughtless literal repetition of content taught. 

2. Individualization. This term has canr>e to be 
used, in the curriculum-package industry, for what 
is generally its opposite, namely the so-called 
diagnostic/prescriptive. Clearly,, in the IDS 
individualization measures, on effort has been 
mode to <ivaid this sloganized meaning of the 
term; the attempts to gather data about 
assignments and grouping, alternative learning 
routes, and sequencing would, I hope, provide o 
basis for further scrutiny of opportunity actually 
afforded children for learning in ways adapted to 
individual talents. 

The teachers' own observational skill and 
inventiveness with respect to supporting children's 
already achieved strengths is, I believe, the best 
clue I can suggest for analytical guidance. This, 
however, is rwt easy infarnrration to conne by in 
any crisp form, and the role of theory con only be 
to suggest wlhot kinds of infornxitian to seek. IDS 
researchers' Qtlempts to discover the degree to 
which teachers creote unique assignments for 
individual studiente and the extent to which teach- 
ers try to improve the sequence through use of 
supplenrientol nrxiterials ore steps toward obtaining 
this infornrwtion. 

In the whole long tradition of "remediol 
teaching," the anoxia analogy gains in plausibility 
from the fact that prescriptions and provisionings 
ore almost universally thought of as based on the 
diagnosis of weaknesses , not on the use of 
children's attained strengths and coupling with the 
motivations which undergird those strengths. For 
exomple: a 2d-grode teacher with seven children 



held back for a yeor from o' previous teocher 
decided to toke them entirely off of the standard 
reading fare^or most of the term. Insteod she 
substituted for them a science corner to which 
they contributed, with much ado about labels; 
treasure tiunt gomes with written instructions; > 
favorite story books read to. them and then read' 
by them, etc. Two weeks before test tiiDe she 
•■pu^^ them to the book** again, for test-taking 
^practice. They all passed. This is only a surface 
description of a teacher*s art in the weaving 
together of reading with other interests found in 
these specific children, but it makes the essentia! 
pointy 

3. Instructional Events. I do not have sufficient 
information to comnr>ent intelligently about spe- 
cific variables under these headings or to know 
where to focus. The overwhelming nnajority of 
them seem to leave out one obvious dimension: 
conversation among children and adults who share 
in work significant to them jointly. Informal 
conversation can of course be idle— but in the 
presence of worthy and absorbing materials and 
tasjc, it is probably the chief instrument of 

. educational rapport. 

4. Motivationol Processes . In the context of the 
sort of variables I would seek to dsffine, this 
category is not as a whole distinguishable from 
the previous one. One could find ways of 
assessing the classroom climate in terms of use of 
children's versus teachers* wall displays, the 
presence of three-dimensional nxiterials available 
for use, the degree of simultaneous diversity of 
activities (and ' passivities) and day-to-day 
maintenance or change of pace, and the quality of 
classroom sound and motion. The most important 
new variable might be a teacher*s capacity to 
orchestrate ground rules, freedoms, and choices 
made available. 

5. Teacher Background . In addition to the kinds 
of information afready categorized, it would be 
importcnt to know from teachers themselves what 
fac,torji or episodes or histories in their own 
background they consider to be most relevant to 
their Current philosophy and practice. In 
particular, it would seem important to direct, their 
attention, in this matter of background, (a) to the 
presence or absence of serious work in (normal) 
child development, and to their judgment about 
the value of 'such study; and (b) to the nature of 
their own subject matter education. 

Summary 

The nature of the IDS and the use of teacher 
consultants in it may provide a basis for further 
apfllysis of existing data and for added empirical 
research. 

From the point of view of the school careers 
of children ond of elucidative research, the 



crucial variables are very partially reflected in 
the study's major input orxl outcon)e variables. 
**Overlap*' is of some importance, but it needs 
disentangling as to whether it means son>ething 
like instructionoiized coaching **for the test** or 
wider significant learning that a test can reliably 
sample. * 

The responses of teacher conferees strongly 
suggest that there be a specific further focus on 
matters directly affecting children*s response in 
school-— on classroom ambience, on teocher s* 
abilities to see needs in relation to learning 
strengths, and on their repertoires for meeting 
these needs when so seen. 

I have suggested that one should look ut 
reasonably small samples at the extremes of what 
are, admittedly, educationally unreliable outcome 
meosures in order to find patterns— complexions 
of recorded or still-needed variables— that seem 
to be more essential than those one has, perforce, 
started with. The aim of this research should be 
explicitly exploratory— not to prove anything, but 
to suggest desirable redefinitions of infornrxition- 
gathering categories. 

The plasticity of children*s learning potentials 
is fur greater thqn the evidence from demographic 
or I.Q. data usually indicates. The reason is 
obviously that situation samplings-sampling of the 
kind that emphasizes the importance of context 
and situation in giving children access to thefr 
own resources for learning— is as difficult as the 
really interesting situations are rare. 

The nDoral is that one -should, for scientific 
valuer throw out large -group averages "for the 
time being and concentrate on the relatively rare 
extreme cases. Reading and math tests are 
geared to prevailing averages and distributions, 
and when read as meaning more, expose us to 
what should be called the demographic fallacy. 
When teachers really tap children's curiosities and 
help them become seriously involved in learning 
over a substantial period, they can show 2- or 3- 
year gains in the narrow skills. According to the 
demographic fallacy, such ^ins are several Stan- - 
dard deviations from the average, and thus to be 
discounted. But in our field, pay dirt is alsd by 
definition rare._ 

Such small -sample exploratory research -can 
only, at first, provide existence theorems— not 
causal relations, and certainly not uniqueness 
theorems, if there are any. But by closer 
observation we nrKiy learn to develop some useful 
theory— better operational definition, moire care- . 
fully constructed information channels— end thus 
hope finally, from the study of larger samples, to 
create public credibility and understanding for 
major directions of improvement. 
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Chapter VI. Individualization of Instruction 

IS IT TRUE WHAT THEY ^AY ABOUT 
INDIVIDUAUZED INSTRUCTION? 



Marianne Amarel 
Educational Testing Service " 
Princeton, Nevy Jersey 



Introduction 

In the spring of 1975 the f iotional Institute of 
Education (NIE) embarked on a comprehensive 
evaluation of compensatory education programs 
supported by Title I of the Elementary and 
Secondary Educotjon Act of 1965 (ESEA) ond state 
funding* Corhpensotory programs enconr^poss a 
wide variety of services intended to reduce or 
overcome the differences in educationoJ attain- 
ment comnDonly found among children vO;ith 
differing socioeconomic backgrounds. The evalua- 
tion' was undertaken in response to a Con- 
gressional nxindate directing NIE to conduct a 
study purposes and effectiveness ^of compen- 
satory education programs so as to provide 
information relevant to future legislative 
decisions regarding primary and secondary educa- 
tion. 

Thie stipulation for evojluation has been built 
into federally funded compensatory programs 
since their inception in the mid-l960's. The 1974 
Amendment to ESEA authorizing NIE to examine 
the programs serving compeasotbry education 
students reiterated Congressional expectations 
thot evaluations be used to inform policy 
decisions. Mandated areas of study ranged from 
an examination of ways used to identify children 
needing compensatory programs to an assessnnent 
of how effectively the children's needs have been 
met. These directives defined the bourKiories of 
the study in general temfis'only; they spok^ to the 
means and strategies of implementing it not at 
all. The challenge, of formulating the: study 
questions about the critical and discriminating 
dimensKKis of a multipurpose and widely spread 
program was quite properly left for NIE to meet. 

A Short History of Lorqe-Scole Evaluations 

During the post several years, numerous 
evaluations of educotionol programsi varied in 
scope and aims, were urxier token. The results of 
large-scale evaluations proved to be-disheortening 
on at least two counts: they failed to demon- 



strate nneasurable, consistent, or notable effects 
oh student attainments that could be linked to 
educational, particularly compensatory, programs; 
they were equally unsuccessful in relating specific 
features of educational contexts to measures of 
effectiveness; The first study to attroct notional 
attention, the Westinghouse/Ohio evaluation of 
Head Start, now appears methodologically naive, 
yet the application of increasfngly sophisticate^^ 
tools hps not yie(,ded more definitive or less 
controversial results (White et al., 1973; SRI, 
197l;\yargoetal., 1972; Dyer, 1978). 

ibutihg differences in the outcomes of . 
to the influence of measurable dimen- 
sions 4f school settings has proved to be equally 
In on oTKilytic review of studies of the 
of school resources on students, Spady 
Finds only equivocal results. Drawing a 
ion between tangible resources and "value 
itis," he directs attention to an aspect of 
!>ls that has resisted measurement and has 
been absent from most impact studies, much 
ir detriment. Evaluations in seorch of 
1-related effects have not fared any 
bettirJ The notional evaluation of Follow Through 
Plonn^ Variation (Stebbins et al., 1977), which 
did dpt^rt some sponsor-related outcomes, is 
curterjtly under challenge (House et al., I9?8). 
Scores of other studies could be cited that failed 
to ^identify dimensions of schooling consistently 
associated with students' educational attainment. 



::The history of Title I evaluations, thoroughly 
documented by McLaughlin (1975), odds up to a 
chronicle of unproductive and, in retrospect, often 
misguidedjactivity. When the assumptions of the. 
input/output model that guided these evaluations 
are closely examined, the model emerges , with 
danrKiged credibility. The suitability of on essen- 
tially technological model for evaluating diverse 
decentralized programs has recently been ques- 
tioned on multiple grounds (Berrymon and 
Glennon, 1978; House, l97W^^JBut, in fact, its 
feasibility has been doubtful for some time, given 
our limited capacity to conceptualize and measure 
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educational Input and output. Instructional pro- 
^grams, Idbeled but largely unexamined/have been 
typically designated as the Input, or as independ- 
ent variables, and standardized test scores hove 
served almost exclusively os the indicators af 
effectiveness, ar output. Evaluations unable to 
detect progran^ differences hove thus been open 
to criticism for the crudity of their measure^', 
while studies that did report differentiol effects 
lacked the finer descriptors needed for reloting 
differences to program chorocteristics. 

Not only the critics but olso' the designers of 
impact studies have pointed out methodologicol, 
conceptuol, ond politicol problems frustrating 
their efforts. Compbell (1975) listed o few under 
the^ generol heading of "meto-scientific issues/ 
indicating the variety of problems const rc^iiir}& 
progrom evoluorion: - ^^^L/ 

. . . there is o precorious rigidity in the 
measurement system, limiting recorded out* 
comes to - those dimensions anticipoted in 
odvonce; process is often neglected in or 
experimentol progrom focussed on the overoll 
effect of o complex treatment, ond thus 
knowing sqch effects hos only equivocol impli- 
cations for progron[i replicotion of improve- 
rnentf '.broad-gqoge^ progroms ore often 
hopelessly o«T)bigOoos os to goals ond relevont 
^indicators; chohges of treatment progrom 
_ during the course of on omeliorotive experi- 
ment, while practicolly essentiol, moke input- 
output experimentol comparisons uninterpret- 
oble; sociol progroms ore often implemented in 
ways that ore poor from on experimentol 
design point oiP view; even under well 
controlled situotions, experimentotion is o 
profoundly « tedious ond equivocol 
process ... (pp. 8, 9) 

On the whole, then, the yield of summory 
evaluations has beefi thin. In the absence of o 
suitoble theoreticol ond methodologicol base for 
identifying ond measuring criticol dimensions of 
schooling and their effects with any confidence, 
the studies did not provide information useful for 
policy decisions. Their utility for educotional 
practice was equally meager, so little relotion did 
they bear to the reality of schooling. 

The studies, however, did bring about o better 
grasp of the problems inherent in assessing the 
impact of sociol programs. Even Compb^i?'s 
broadside, properly regarded os o^-more differen- 
tioted conception of the evoluotion process, draws 
on lessons culled from the earlier investigations. 

,The Instructional Dimensions Study 

The Compensatory Education Study derived 
from this legacy o clearer awareness of foctors 



impeding the assessment of multiform sociol 
programs. The study staff recognized the delinea- 
tion of appropriate and feasible foci as o cruciol 
step in framing the inquiry. The oreof of Title I 
impact selected for examination were broadened 
at the same time that the questions addressed 
within the oreas were shorpened more thon had 
been the case in post evoluotions. 

Four major oreas ivere selected: (I) funds 
ollocotion, (2) service delivery, (3) student 
development, and (4) progroi-n administration. 
_Ti)e present poper deals with just one of the 35 
separate studies that mode up the total effort, 
namely, the Instructional Dimensions Study (IDS). 
The major reseorch effort in the area of student 
development, the IDS was designed to evaluate 
the effectiveness of instruction provided to com- 
pensatory educotion students. Its scope was 
limited to redding and mathematics instruction at 
1st- and 3d-grade levels. More specif icolly, the 
study examined the relationship between selected 
characteristics of instruction and student develop- 
ment. Four dimensions of instructional settings 
were chosen for close scrutiny: (o) pullout and 
mainstream instruction, (b) intensity of instruc- 
tian; (c) content of instruction; and (d) individu- 
alized instruction. The summary of findings 
reported in the Effects of Services on Student 
Development (NIfc, reveals that overall, the 

students in the sample registered high rotes of 
achievement. Five sets of classroom processes 
(opportunity, individualization, instructional 
events, motivational processes, teacher back- 
ground) were found to be strongly related to 
achievement, when token in combination. By 
itself, the effect of individualization was not 
found to bear o significant relationship to student 
achievement, compared with other modes of 
instruction. 

The present paper concerns the classroom 
processes subsumed under the dimension of in- 
dividualization. It grew out of the author's par- 
ticipation in a 2-day meeting arranged by NIE, 
when 40 of the study teachers were convened to 
discuss and reflect on the findings in light of their 
knowledge and experience. 

For purposes of the IDS, individualized instruc- 
tion hos been defined to conform with the intent 
of the legislative mandate, as interpreted by the 
NIE study staff. By singling out the "use of 
individualized written educational plans for child- 
ren," Congress was indicating special interest in 
the perfornrKince oif programs using this practice. 
The definition ultimately used was more inclusive, 
encompassing o set of strategies believed descrip- ^ 
five of individualized instruction os it is typically 
implemented in schools. 



Ciossroorm were rated on the degree of 
indivtduanzation by the use of d combined assess* 
^ ment of selected classroom processesi primarily: 

(I) The assignment of specific learning 
objectives or octivities to individual 
children 

/ (2) The use of diognostic end prescriptive 
activities • 

(3) The existence of olternative learning paths 
and sequencing for individual children 

(4) The use of individuol or smoll-group pocing 

In this interpretotion, the use of tests became 
the sine qua non of individual izotion. The overoll 
classroom score wos heavily weighted foword 
individualizotion when tests were used for setting 
objectives, placing students, assessing progress, 
ond confirming mastery. 

The strotegy of using feotures of the instruc- 
. tionoll process or the classroom setting as 
predi<itor voriables represented o step forword 
^ from /evoluat ions based on global program com- 
parisons. The latter approach olmost invoriobly 
,^ fouhdj within-progrom differences equal to or 
greof^Jr than between-prog ram differences in out-^ 
comoj owing in port to program variotions across 
locol ities, schools, ond classrooms. 

Considerdble and creditable work went into 
specifying the instructional process charocter- 
istics thot would %\qn\\y individuol izotion (Cooley 
and Leinhordt, I975>. The instructional tech- 
niques selected fell under the generol rubric of 
diagnostic/prescriptive instruction, a nx>del now 
1^ receiving a good deal of ottention. Individuol ized 
instruction was defined to represent this generol 
model, in the expectotion that the claims and 
counterclaims nrwde in its behalf would be odjudi- 
coted by sound evidence. 

A Short History of Individuol ized Instruction 

Although differences in learners had been 
recognized before the odvent of mentol measure- 
ment, the greatly increased use of intelligence 
and achievement tests ofter World Wor I, which 
'\ formally documented diversity ombng students, 
confronted the schools with an open chollenge to 
acknowledge and respond to the heterogeneity of 
their populotion. As early as 53 yeors ago, the 
Notional Society for the Study of Educotion 
devoted its yearbook to the topic of "Adopting the 
Schools to Individuol Differences." In the intro- 
duction to the volume, Woshburne (1925) reported: 

It has beconr^ palpably absurd to expect to 
achieve uniform results from uniform assign- 



rhents nruide to a closs of widely differing 
individuals. Throughout the educational world 
there has therefore awakened a desire to find 
some way of adapting schools to the c fering 
rndividuals who attend them. This desire has 
resulted in o voriety of experiments. ^.1) 

Individual differences in learning, in f bet, hod 
been. rx>ted long before the advent of '^biic 
schooling. An early example of individualized 
instruction, doting from the first c«itury, can be 
found in the Jewish Passover service, which 
commemorotes the exodus of the Hebrews from 
Egypt. In the rituol of retelling the story'^^T 
.oppression, resistonce, ond rescue through the 
. parted Red Seo into the Sinoi Desert, the leader 
, of the service is instructed to suit the telling of 
the story to the children who ore listening. Four 
kinds of children ore identified: the wise child, 
the irreverent child, the simple child, ond- the 
child who does not know how to oSk ony questions. 
The prescription of how to vory the telling of the 
story is thus based on o diognostic proc,e5s thot 
onolyzes the noture of questions children ask. 

More recently, the prevolence of leorner 
differences wos dgoin noted by Gqge (1967), who 
roised some discomfiting questions: 

. . . Learners do differ in woys relevant to 
their ability to profit from different kinds of 
instruction, content, incentives, ond Xvib like; 
Almost by definition, instruction adapted to 
these individual differences should be nwe 
effective. 



If so, why has not the evidence froni 
ottempts to individuolize instruction yielded 
more dramotic results? Why ore not the mean 
scores on achievement measures of pupils 
taught with due respect to their individual 
needs and abilities substontiolly higher, in 
unmistakable woys, than those of students 
taught in the conventional blossroom, where 
everyone reads the some book, listens to the 
, some lecture, participates in the some class-, 
room discussion, moves ot the same pace, and 
works ot the some problems? 

Reflecting on the some questionSj Gioser 
suggests thot the effects of individualizotion ore 
masked by the lock of detoiled informotion obout 
the relotionshtps between instructionol methods 
and individual learning copabilities. He identifies 
o set of . necessary conditions for the implementa- 
tion of individuolized instruction (Closer, 1967): 

i> The conventionol boundories of grode levels 
ond orbitrory time units for subject-mot ter 
coveroge need to be redesigned to permit 
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^^^^^^y^* to work ot hit octual level of 
Qccompliihment In o lubjeetwnatf er oreoi 
and to permit hfm to ntbve oheod a$ «oon as 
he nrxisters the prerequisites for the nejct 

' level of advancement. 

■ : ■ . ■ . \ 

2. Well-defined sequences of progressive, 
behoviorally*defined objectives in various 
subject areas need to be established as 
guidelines for setting up a student's pro- 
gram of stud/,. The studenfs ochievement 
is defined by his position along this pro- 
gression of . advancement. 

3. A student's progress through o curriculum 
sequence must be monltbred by adequate 
methods, and instruments for assessing his 
abilities and accomplishments so that a 
teaching program con be adapted to his 

• requirements. 

4. Students must be. taught ond provided with 
appropriate instructional materials so that 
they acquire increasi'ng competence in self- 
directed learning, lo accomplish this, the^ ^ 
teacher must provide the student with 
standards of performonce so that he can 

• evaluate his own attainment, and teaching 
activities must be directed by individual 

, learner accomplishment. 



5. Special professional training must be 
provided to school personnel so that they 
con accomplish the evaluation, diagnosis^ ^ 
and guidance of student performance that 
is required to organize instruction for 
individualized learning— as coot rested, to 
the total-class management of learning. 

The. individualization of instnictioh . 
requires that the teacher attend to and 
. utilize detailed information about eOch 
student in order to design appropriate 
instructional programs. To assist the 
teacher in processing this information, it 
seems likely that schools wijl tjoke 
advantage of efficient data processing 
systems, (p. 3) 

The origins of the definition of individual iza- 
ion used by NIE are clearly discernible in this 
itline. In fact, the index devised to rate the- 
figree of individualization in classrooms incor- 
>rated its. essential features. In the classrooms 
ited high on individualization, then, the require- 
ents posited by Closer con be assumed to have 
sen nr>et, at least to a practicable degree. Yet, 
dividuolization was not found to benefit com- 



pensatory education students more ffkm other 
types of in8tructk)n. Apparently, not even under 
thes^^ .^itkra Is the expected superiority of 
ipdiviAwllzation readily demon$trd>le» 

^ 'irSP ^''9*'t to gain a better understanding of 
the IDS results, NIE convened 40 tcochers to 
review,^ discuss, and help interpret the major 
findings of the sUxfy. The teachers' persfjiectlves 
ore highlighted in the next section. 

The Teachers' Views 

The assembled teachers reflected the spread 
of prdcticesin the total study sample, which was 
considerable. The ratings- of the teachers* rooms 
on the index of individualization were not knovyn 
to the conference participonts, nor were the 
teachers aware of their own rating. The com- 
ments and judgments about the proffered model 
thus could not be related to the teachers' ratings 
although tliey could be linked to specific practices 
desccibed. ^ 

The discussions testified to the difficulty of 
isolating on Wtructionol dinnension for analytic 
focus. Although individualization was the topic 
for the sessions -on "which these comments rest, 
other dimensions, such as setting, content, oppor- 
tunity, etc., regularly entered the discussions. 

The exchange of views was hindered by a 
problem of verbal labels. Individual i/at ion, q 
term lacking a commonly dgreed-on referent, 
nonetheless hod positive connotations ^or the 
teachers. All believed they practiced it, even/ if 
through different approaches and to varying 
degrees. For the teachers, individualization was q 
label to which a good deal of personol /and 
experiential meaning' occrueef. When confrcinted 
with NIE's definition —asked, in loct^ to replace 
their own definition wilh NIE's, eleiments of , Which 
did not overlap, or even ron counter to their own 
practices— considerable cortfuslon ensued./ While 
talking about the benefits, drowbocks, and class-- 
room practices related to individualization, the 
teachers inevitably lost grip on the newlyVocquired 
definition and responded in terms of their own, 
longer held understanding of the terrn. This 
confusion of tongues rK>twithstanding, the discus-- 
sions clarified some of the issues raised by study. 

A most important contribution was the 
teochers' evident imnDcrsion in the unadulterated 



The index was derived from several differentially 
weighted variables yielding a single number that 
allowed the ordering of classroom on a linear 
scale. The teachers were aware of the compo- 
nent variable, but not of how fhey were com- 
bined. 



reality^ of clossroom life, which contrasted 
morkedly with the schematized representations to 
which evaluation studies necessarily reduce^ it* 
The teochers' talk, brinruning with particularistic 
. details rooted in day-by-diay experience, was a 
sharp reminder of the risks of nongrounded 
theorizing and of the premature imposition of 
conceptual schemata on events and settings whose 
salient dimensions are only partially understood. 
The discrepancy between the teachers! reality and 
the desiccated variables used in most studies that 
aim for general izable oOtcomes across q wide 
range of settings and farflung populations was 
apparent throughout the meeting. 

Accounts of quotidian routines and activities 
oncho red much of the discussion. Although time 
limits^ept .teachers from describing programs in 
depth* and fine detail, the diversity of their 
practices was notable. The specifics of the NIE 
definition were played off their variegated 
approaches. Bare bones of variables such as 
pockaging, sequencing, etc, were fleshed out by 
classroom vignettes. Cutting through the surface 
diversity of the practices described, one could 
infer some commonalities ih the way teachers 
construed the dirnensions ofv individualization: 
teachers found the diagnostic/prescriptive model 
nrx>st easily. If not exclusively, applicable to the 
use of certain types of instructional materials, 
specifically those with objectives organised into 
hierarchies. The model was also seen as more 
suited to the attainment of concrete, discrete, 
short-term instructional goals than^ to long-term, 
integrative, dev(?lopmental aims stated in holistic 
terms. 

As the structure of classroom organization was 
not a pivotal aspect of the NIE definition, it was 
surprising to realize that, in many of the teachers' 
judgments, the only organizational arrangements 
that fitted comfortably Vi'\\ the requirements of 
individualization were on to one tutorials, or 
situations in which the ch id worked alone with 
self-paced materials. Apparently, the other com- 
ponents of individualization ' so constrained the 
possible arrangements as to rule out a common 
form of classroom organization— small groups. 
This perception hod important consequences for 
the way teachers judged the assets and liabilities 
,of individualization. 

Major Themes 

The teochers* comments did not fold into neat 
classifications. Recurrent concerns emerged 
nyore as leitmotifs that were threaded through the 
discussions. Two of these will be briefly elabo- 
rated. Both relate to the generic issue of the 
teacher role: one concerns goal setting, and the 
other speoks to the place of teacher judgment in 
the pedagogical process. 



Teaching Goals , The breadth and complexity 
of teoching goals subsumed by the definition of 
individualization proved to be a thematic concern. 
As mentioned before, the diagnostic/prescriptive 
model was seen by nr>pst teachers to apply to the 
teaching of academic subjects, if these were 
divisible into specifiable units that could be 
learned in the short term, and their mastery could 
be confirmed by an available test. Some of the 
teachers seemed to construe their role as 
consonant with these goals; i.e., they saw their 
primary task as helping children acquire the 
component skills that are assumed to cumulate 
into higher level abilities. Not surprisingly, more 
teachers who were not Jn charge of classrooms 
held this view, namely, the compensatory teachers 
who worked with children for limited time periods 
on a specific subject that was judged in need of 
remediation. The majority of teachers, however, 
had a different conception of their role. They 
regarded the aims and purposes of elementary 
school teaching as more comprehensive,^ longer 
range, and, above all, more interrelated. Many 
found it difficult, it not unproductive, to isolate 
academic learning- frorp the broader develop- 
mental and social goals they held for the chil- 
dren— goals that guided their instructional, 
decisions and practices in large nrieasure. 

One teacher spoke for many of her colleagues 
when she enumerated some qualities of the 
learning environment she intended to create: 

I dm concernt-d that children have time to 
express their opinions, their feelings, that they 
be listened to, have the opportunity to deal 
with disagreement, with each others* ideas. 
Time is also needed for the development of 
critical skills, for comprehension. - 

The development of a sound and ser/iceable 
self-concept also loomed large in most teachers' 
agenda. "Self-concept" seemed to be the 
teachers' shorthand for expressing their concern 
for the student as a person, for placing the more 
academic objectives in relation to the learner. 
Supporting positive self-regard was seen as 
cutting across all of teaching and, for many 
teachers, as one of their most important tasks. 

Perhaps the most troubl ing feature of the 
diagnostic/prescriptive model for the teachers 
stemmed from their perception that it precluded 
small learning groups. Teachers were forceful in 
their arguments that children need to work 
together. They tended to see their classroom as 
an organic social unit, not as a loose aggregate of 
individual children. The development of inter- 
personal codes, social rules, and reciprocal 
r exchanges was not only valued for itself but was 
regarded as the necessary context for optimal 
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cognitive developmmn To help children achieve 
a modicum^of occeptonce and respect from'^their 
peersy to enable thenn to secure a place in the 
class comnrKmity was a highly valued. If not 
always fully reallzedi priority, r Encouraging 
mutual old, providing opportunities for children to 
listen to each other, comparing ideosi and 
resolving or accepting differences were all sub- 
sumed under this general goal ond linked to the 
development of self-esteenru Most teachers were 
mindful of the relationship between the students' 
self-concept and their capacity to learn. These 
cornpensatory education teochers, who by virtue 
of their role did not see children in their class^ 
roorn habitat, dealt with'.simiior corK:ems os they, 
talked of the efforts they mode ,to present 
participation in the program os a privilege and the 
^ins they took to protect chilch-en from the 
stigma of being singled out for remediotion. 



The effects of children working on their own 
were not seen in negative terms only. A few 
teachers looked on solitary work as;0 woy to 
protect children from failure in public ond from 
excessive competition with peers. Others saw 
opportunities for the development of self- 
direction.^d autonomy. The purpose and extent 
of working olone finally determined teachers' view 
of the practice; they recognized the need for 
children to do so,. but became concerned when the 
line between working independently ond working 
in isolotion became blurred. 



The holistic goals thot mony teachers shored 
were not easily absorbed by the 
diagnostic/prescriptive model; they are not 
reodily segmented into stepped learning 
objectives, nor is their mastery meosurable by 
standardized instruments. Yet such goals hove 
great salience for teachers, with significont 
influence on their teaching practice. In part to 
accommodate these aims, most teachers modified 
the programs they, were implementing. It is 
importont to recoil here that the teachers oil hod 
had p minimum of I year's experience with 
whatever program they were using and thus a 
chance to put their own stamp on it. The 
odaptotions ranged widely, most foiling short of 
the teacher whose response to how she shaped the 
progranT) was "Actually, .1 modified it by nruwtly 
throwing it out." Other teachers described 
limiting preiscriptive/diagnostic teaching to 
portions of the schoolday and supplementing the 
prescribed materials and activities. 

Teachers odopted the programs in response to 
individual differences— to toke account of chil,. 
dren's interests, learning styles, or motivotionol 
foctors, based on their own judgment os to whot 
would work best. 



Teocher Judgment . The topic of teacher 
Judgment was perhops'the dominant theme of the 
meeting. Teacher judgment is required to trans- 
form general ospirotions for d class into differen- 
tiated goals for individuol children. Professionol 
judgment is even more deeply implicoted In the 
way teachers seek to realize their pedogogicol 
aims. This, of course, is the heart of teaching- 
selecting and providing the means to best support 
the development of- each child. The 
diagnostic/prescriptive programs, when followed 
to the letter, do not letfgp much room for the 
exercise of teacher judgment. The what of 
teaching is determined by prescribed objectives, 
children's needs ore determined by diagnostic 
measures, and the how of teaching is supplied by 
prescribed moteriols and activities. The tightness 
of the prescriptions voried ocross programs, from 
the specif icot ion of exact steps to be followed and 
of skill drills and techniques for reinforcing the 
skills, to programs thot provided olternative 
moteriols and paths thot teachers and students 
could choose to follow. Again, the teachers whose 
role wos limited to compensatory instruction 
tended to . hove fewer options in what and how 
they tought. One teacher remarked that she 
sometinnes felt like on outomoton, so restricted 
wos her teaching domoin. 

The sound exercise of teacher judgment, 
however, exocts its own imperotives. The oppor- 
tunity to observe and interact with students, to 
"study"' them, in effect, is indispensable for 
acquiring the informotion needed to respond to 
children differentiolly. The diagnostic and 
mastery teists built into the individualized pro- 
grams provided on abimdonce of informotion about 
student performonce on the skill objectives. 
Teachers used these to sequence the next objec- 
tive ond to assess the pace of students' progress. 
The tests, however, did not speak to other 
prominent teacher concerns. The results did not 
Inform teachers about the nature of the children's 
interests, their preferred modes of work, what 
motivated them, what aroused their onxiety, or 
how they felt about themselves. Seveifol teachers 
shored the conviction that elementory school 
instruction requires this comprehensive view of 
the learner. One of the teachers enumeroted part 
of whot she ottends to when working with 
children: 

. . . I observe children to f i^ out how do they 
learn best, how do they function in o group, do 
they pay attention oil the time or som^ of the 
time . . . how ore they cored for, how ore they 
dressed ... to find the woy to assure them, do 
they like to be hugged, or be proised .... 

Forming such judgments wos seen as pivotol to 
the teaching function* Teachers did not expect 
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Qssesvnent instamients to do it fpr.them, but they 
did need the opportunity to observe students* 
working with others, to see them function in o 
variety of settings, at well 09 tb interact with 
them one-on-one. A close odherence to the 
routines of o diogrx>stic/prescriptive program 
clos^ off some of these opportunities: it 
curtoiled group octivity, the prescribed objectives 
limited the* variety of learning gools, and the 
segmentation of the curriculum content ¥^s not 
conducive to r«5veo!ing the student!if under- 
standings and thought processes in -nuch depth ar 
scope. ^ , 

Few teochers, judging h/ their own reports, 
implemented the individual i/ed;pi^ograms by tt^e 
book. When their situation permitted It, they 
exercised their judgment and acted on their 
priorities. Progroms were odopted to suit the 
children, 05 well as to harnrK>nize with the 
timbers' preferences, values, ond skills^ Perhaps 
the rnost paradoxical aspect of many indivi- 
dualized programs. is the failure to ockrjowledye 
that teachers too hove interests, preferred 
approaches, and vah p perspectivrs* The dis- 
cussions provided omple^ evidence that teachers 
differ in ihe ways they constrtie their ro!e and in 
the organising priorities that guide their practice. 
Il was this diversify of perceptions that resulted 
in the scrupulous implementation of programs by 
sivne teochets and their partial or extensive 
fTKxlifiration by others. Teochers, however, are 
not always free to determine the course af their 
own instruction, which leads to varying degrees of 

/ overlap betv een what they fee! comfortable and 

f competent to do and what they in fact do. A 
fnisoli^nment between overt teaching practices 
and the teacher's underlying pedagogical belief 

y system can hove unwelcome effects (Bussis et al., 

\l5f76). 

Xo^textuol Factory In the foregoing sections, 
differences in assun>ptions abou teduca tionol goals 
and practices held hy thr^TT^hrrl''^nncL.Jhnir 
underlyihg the IDS>*€re pointed out io an otten^pt 
to begin' tb"wd€rfstand why individuolizbtion did 
not relate ta student gains. In the next section, . 
features of the brood school^ setting, which 
eiiierged during the discussk>ns as likely to affect 
^tudent achievement, will be described briefly. 
Although these situational foctors were not con- 
sidered irwthe IDS, tHey hove pfousibilitx as 
influential }^iables and serve to point out once 
ogatn that similarly labeled teoching practices 
fjKTf mask vital differences. 

Typically, comlp^nsotory education was 
••delivered" to the sfxx^mts by sonr>eone other than 
the classroom teoc^r. tt>e case of'pullout 
programs o special Title I teocher, often o 
reading or nrnrth specialist, was responsibJe. In 



pro^oms that were nDoinstreamed, it was o 
special teacher coming in the room or an aide wha 
was identified as the conlpensatory education 
teocher. The teachers attributed considerable 
importonce to the relationship between the child's 
classroom teacher and the teacher responsible for 
the compensatory instruction. In schools where 
students were pulled out from their classrooms, 
this relationship was especially important, as the 
classroom teacher was not present during these 
instructional episodes. The nature of coordinotioh 
ranged from close collaboration between the 
teachers, involving joint goal setting and frequent 
information exchange/ about the students' pro- 
gress, to virtually ^ contact between the two 
teachers, and therefore no coordination of the 
children's experience in the two settings. In 
rooms that mains treamed the compensatory edu- 
cation program, coordination was less of o 
problem. When compensatory education funds 
supported a classroom aide, it wos virtually 
ensured, in coses where special compensatory 
edtKiotion personnel visited the classroom to work 
' with selected children, the program tended to he 
more independent of classroom instruction. 

• Another source of variation was reported in 
the way schools scheduled the compensotory 
education program. In some situations students 
received compensatory instruction while their 
, classmates hod music, art, or physical education, 
^ \^tched film^, or participated in other, not 
strictly acadernjc activities. In other schools, 
every effort was mode to see that the children 
were not deprived of common class experiences in 
favor of compensatory education. 

Yet another variable nr^entioned wos the 
degree of parent involvement. Examples were 
cited of extensive training programs offered to 
parents in the principles of diognostic/prescriptive 
.instruction, along with materials and guides^urging 
. parents to continue the instruction at home. More 
comjnonly, parents were occasional visitors to the 
school, nruiintaining differing degrees of contoct. 

The training of the staff administering com- 
pensatory education was another factor mcn- 
tiGned. In schools^ where special, or auxiliary, 
staff member^ were responsible, not only their 
training, but the status they hold in the school 
coninrHinity, and even the location Vye they 
carry out their work moy be influeojiof factors. 
As was the cose with every other vornble, notable 
differences were reported. Inlsome schools Title I 
staff were highly trained professionals; in some 
other schools, they were highly trained nonpro- 
fessionals. In some mstr/^j.es, preparation seemed 
modest. * The plope of .v-.'truction, in the cose of 
pullout programs^ 'variec(, most likely in concert 
with the status of the positica Special rooms, 



weil-«quipped "lobs,'^ were the scene af 
Instruction in some schools, while the hallway 
served the purpose in others. 

Schools gIsq differed in the proportion of 
.students receiving compensatory edgcotion, which 
almost certoinly reflected the socioeconomic 
bockground of the student body— o vorioble often 
found correloted with scholastic ochievement. 
The teochers olso mentioned curriculum and pro- 
gram relotion differences. The approach to 
instructing Title I students wos generolly consist- 
ent in some schools, while in others more than one 
qpprooch or program wos being implemented. 

The quality ond substonce of collegiolity ovoil- 
ab!e to teachers wos reported to be on important 
determinant of the teachers* perceptions of their 
work environment, as wos the role of odministro- 
tive support in mointoining o favorable school 
climote. As might be expected, th?* schools 
differed on these dimensions os weH. 

Most if not all of these vorio*ions in schoof 
settings and routines con be assumed to be 
orthogonol to the degree of individuollzotion, yet 
their relotionship to achievement scores connor be 
ruled out. 

Code 

Only mogicol thinking would leod anyone to 
expect thot 2 o>»ys of freewheeling discussion with 
, 40 teachers would moke the findings of on 
intricote and ombitious study y fully compre- 
hensible, yet the teochers* cofA(nents provide 
interpretive guides not present in the other data. 

The IDS speaks to two questions thot hove 
preoccupied educotionol research and evaluation; 
it focuses on one directly, on the other more 
obliquely. T^e relotionship be we en selected 
instruct ionol fJroctices and student developnr>ent 
was the centrol study question. The selection of 
an appropriote strategy for uncovering such links 
was addressed less directly. These seemingly 
separate issues ultimately converge, for the 
assumptions underlying one invoriably shope the 
approach to the other. * 

First, o comment on evoiluotioff strategy. The 
conceptualization of individuolizotion c^. an 
instructional tiM:hnique-*a sum of o set cf b ' x:- 
tlonol practices that could be meosurev i oss 
settings— largely excludf*d contextual and c ^nt- 
or teocher-related foctors from consideration as 
variables affecting learning outcomes. Sudh on 
assumption is only justified if instructionol tech^ 
niques do not internet with qualities of teochers 
or students, but insteod unfoilingly produce their 



effects ocross settings. The teochers' occountsi 
which suggest that similar practices are perceived 
and valued differently by different teachers and in 
different school ehvironmentSi cost considerable 
doubt on this premise. 

The design of the IDS wos olso shaped by the 
expectotion of additive linear relotionships 
between the indicotors of individual izotion, such 
OS pacing ond sequencing, ond student ottoinment. 
The presumption of o simple, regulor form of "the 
more the better" has been challenged repeotedly 
for psychosociol voriobles, where curvilinear relo- 
tions ore often fowd. 

Finolly, there is the insistent theme of the 
noture of diognostic/prescriptive instruction itself 
ond the relotionship it bears to student leorning. 
Diagnostic/prescriptive progroms consist pri- 
morily of o sequentlol ordering of subject motter, 
with instructionol suggestions oh how to deploy 
the occompanying diognostic instruments ond 
teaching moteriols. Such progroms may be Ipoked 
upon OS resources and tools provided for" the 
teacher 1- jse ot her discretion, or, in controsf, as 
directives <xi whot ond how to instmct students. 
These polar views, and the gradations between 
them, were represented in the group of teachers 
convened, with the mojority odvocoting using the 
principles and moteriol of the individualized pro- 
groms as teaching oides in,a brooder context of 
pedogogicol priorities and proctices. Teachers 
generolly assumed responsibility for o for more 
comprehensive domoin than the one typicolly 
encompassed by the skill objectives of 
diagnostic/prescriptive programs. More impor- 
tant, the processes of ocquiring such skills were 
seen as reloted to qualities of leorners and their 
interoctions with rnodes of instruction— factors 
thot teachers wished to take into account as they 
mapped out paths to learning for the students. 
Teochers, in essence, aspired to personolize 
instructionol encounters, not only to indivtduaiize 
them^ 

The IDS findings indicate that students can 
ottoin high test score gains in individualized 
programs implemented by experienced teochers, 
but thot comparable gains are achieved by 
students in less individualized programs. The 
teochers* comments olso suggest that the issw 
goes beyond the question of what works, ' in 
ochlevefVient tesf-terms, centering finally on the 
volue-loden question of wtnit It is thot we wont to 
work—what image of the educational process, 
what roles for teochers and learners ore envi- 
sioned and desired* One image of ttie learning 
child is of on octive, purposeful being who 
interocts, rott>er thon simpty responds to the 
opporti^.nities and constroints present in any edu- 
cotkjnol setting. The learning process, in short, is 



seen as embedded in the person. The parallel to 
this conception of the leorner is found in the 
perception of the teacher as an active, purposeful 
decisionmaker who uses the instructional 
resources Mailable to best realize differentiated 
goals formulated for the students. There ore 
other visions^ of couf se, that grant less autonomy 
to both the teacher and the learner. The model af 
individualized leorning used in the IDS is more 
consonant with the latter perspective. 

It, is instructive ta return to Closer once more, 
u ' full decade after his conceptualization af 
individuolized instruction. In the intervening 
years the model has evolved and transformed ta 
become adoptive education . Closer (1977) briefly 
describes the essential elements af an educational 
system that is adoptive ta the individual: 

It provides a variety af alternatives far 
learning and many goo Is frorr* which to choose. 
It ot tempts ta utilize and develop the capobili- 
tics that on individuol brings to these alterna- 
tives ond ta adjust ta the learner's porticuidf 
talents, strengths, and weaknesses. Also, ar 
adoptive educational environment attempts ta 



strengthen on individual's ability to meet the 
demonds of available educational opportunities 
and develop the skills necessary for success in 
the complex world. 

The implications of this vision are far-reach- 
ing. : It grants the learner active participotion in 
instructional decisk>ns while implying the sus- 
tained presence af a teacher who observes, 
evaluates, and provisions. Such an environment 
will not result from the implementation af pre- 
ordained learning objectives and instructional 
octivities designed in the absence af particular 
learners. The image af adoptive education calls 
for on investment in professional development 
rather than prepackaged curriculum plans and 
materials. It also suggests the legitimization af 
evaluative judgments about a brood nrray af 
learning priorities and outcomes by mare 
informal, teacher-centered procedures than those 
embedded in standardized assessment techniques. 

It is to be hoped that the findings af the IDS 
will result in the pursuit af these bolder 
aspirations for schooling. 
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IntroductioTi 



The intent of this paper is to describe the 
origin of compensatory edocation program and to 
show ham individuolized instruction (or education 
for individuals) evolved from connpensatory educo- 
tion programs. The paper wos prompted by the 
author's portlcipotton in a 2-day conference ar- 
ranged by the Notional Institute of Education 
(NIE) to consider the findings from the 
Instructional Oinlenslons Study (IDS). This is one 
of 35 studies undertdcen by NIE to evaluate the 
effectiveness of compensatory education. Also 
ottending the conference were 40 teachers who 
hod participated in the IDS. My porticulor charge 
was to report the teachers' responses to the 
findings regarding individualized instruction. The 
study showed tfriot students in programs rated high 
on individuolization did not hove more progress 
than ones in programs rated lower. I hove 
ottempted to contrast the IDS definition of 
indivi(^lized instruction with the definitions of- 
fered by teachers and the definitions used in other 
research. Fincfings from other reseorch on indi- 
» vidualized instruction ore compared with the IDS 
findings* 

Compensatory Education 

In response to public demands, Congress has 
allocated vast suns of money to improve ttie life 
chances of minority groups. It was not difficult to 
see that fdi lure began for minority people in the 
first grodes of school. Notional standardized 
testing programs showed that the disadvantaged 
populotions scored well below notional norms. In 
on effort to reduce educational inequities. 
Congress dbtributed funds through the states in 
the form of T?tle I - Title VII programs. Much of 
thb funding hos been directed toward the educo- 
tion of tfte economlcolly disodvontoged, and hos 
taken occount of the best professional advice 
edOcofors could offer. 

Becouae minority chilidren hod so often scored 
below the norm on stondordized tests, educators 
and Congressmen olike ogreed on one pointi 
troditional currkulo, moterlols, and methods did 
not meet the needs of minority populations. No 



one really knew under what conditions the 
economical I y and educoti onol I y disadvantaged 
would prosper, so that the education programs 
finally funded represented a wide range of edu- 
cational approaches. Each approach was some 
educational theorist's answer to meeting the needs 
of the educationally and economically 
disadvantaged. This method of funding was not 
free of problems, since some experiments were 
not OS effective as others, but it has hod the great 
advantage that, over more than a dozen years of 
Congressional support, these experirnentol educo- 
tion programs hove produced a large body of 
informotion and studies on ; the effects of 
compensatory education. 



Individuol-Abilities ond Education 

Work by Guilford (1967) on individual abilities 
released educators from thinking in the single 
dimension of ihtelligence quotients and spurred 
interest in the conditions that would promote 
learning for students with differing abilities. In 
the \96(3ts and 1970^ a considerable number of 
studies were conducted to see whether students 
with porticulor aptitudes or dbilities prospered in 
porticukir learning environments. For exOmple, 
how did students varying from low to high visual 
sequencing ability prosper in learning environ- 
ments using phonic or whole-word reoding meth- 
ods? This type of study was called Aptitude 
Treatment Interactions (ATI). Crohboch and Snow 
(1977) hove sumnrxirized the findings from a 
sizable body of ibe research. 

It was this thinking about individual abilities 
and treatments that prompted educational theor- 
ists and proctitioners to vary from the traditional 
methods of lecture, drill, review, and test. In the 
I960*s, English Infant Schools in Leicestershire 
County, UJ<., were experimenting with open 
ckissrooms wt^ere children selected ttwir learning 
tasks for the day from a variety of learning 
centers. Children were believed to be innately 
curkxis and, given a wide selection, it was 
believed ttxit every child would choose what he or 
she needed for a sound educationoB diet. Mony 
American schools subsequently foJIowed some 
variation of this pattern, and many schools in the 



kite i96(fs cf%d i97(fs ifoliowed the open-ckissroom 
approach. How *he curriculum was monoged 
within the ope^i classroom voried considerobly4 

Wi^h the vost sums available from the Govern- 
ment for research in educatioot many ideas about 
whet would work best with low-incoa)e| «Juca- 
tiooolly disodvontoged children could be tried. 
Because reading was considered the springboard to 
other knowledge, the teaching of reeding became 
'he focal point of much expcrimentotipn. New 
HDethodologies based upon guesses and experience 
of researchers and practitioners were set into 
practice. These included color-coded readinr, 
behavior nDodificotion, experience charts, task 
analysis, phonetic analysis, the Slingerland 
method, the Fernald method, the Sullivan riiethod, 
student contracts, and many combinolions of the 
above. Book companies' explorations seemed 
limitless. Many new phonetic analysis series and 
programed materiols hit the market. The old 
"Dick and Jane" books Were replaced by books 
showing children with darker skins and showing 
more pictures of inner-city living and less subur- 
ban and rural living. There was enough money to 
try everything, and it seems as though everything 
was tried. 

Evaluation 

Having Junded educational reform. Congress 
then sought to learn whether or not the additional 
dollars were improving the education and thus the 
life chances of economically disadvantaged 
children. To answer this question, several large 
evaluations were mounted. For; the most part, the 
findings from the first studies corniucted in the 
late 1960's and early \97(ys were disappointing. 
The Westinghouse Ohio report of Head Start found 
that gains students mode in preschool were no 
longer evident at the end of 1st grade. Coleman 
and the many others who reanalyzed his doto 
(Mosteller and Moynihan, 1972; Jencks, 1972) 
found no relationships between progress students 
mode and what the schools provided in terms of 
services and programs. In a more extensive 
review, Spody (1973) also reports mixed results 
from studies focusing on the relationship between 
measurable school resources and student teaming. 
However, all of these studies nr)easured differ- 
ences between schools, not the variation of 
treatment within ckosroonns within scIxmIs. 
(Recent studies by Stollings et ol. [i977, 197^) 
have found as much variance within schools as 
among schools, whether on reoding g^'n scores or 
on pretest and post test scores.) 



Researchers and practitioners close to the 
educotionol Innovations being implemented were 
convinced thot these large-scale evaluations were 
overkxjking the most important variables— that is, 



what was oecjfrlng In Indivic^AKil cimrooms. In 
the early 1970's, Brophy <snd f: wtson, Sropliy and 
ijood. Soar, and Stalllngs sTiorpened fhelr focus 
ond began to ^fudy specific r;lements of ijducation 
pro^oms OS ^•y were carried out in clossrocMS 
Such ckjssroonn research required new methods 
and n^-r. statistical techniques. Venation in 
c\Q5S.i\yor(t envlroRnr»ents and instructional process- 
es hic to be docjmented i^. quantitative forms 
'hat could be used in statistical oholys^s. 

Several systematic observotj^vi systems were 
deveJoped. Cor;siderable effort was expended 
toward reliably recording the materials being 
used, the grouping arrangements in classroor-is, 
th? instructional patterns of teachers, and the 
behavior of children. With ihis documentation in 
hand, it was then of interest to see how children 
prospered 1n the various environments. Previous 
studies of schools had considered student scores 
on standardized achievement tests only. While 
success in reading and moth renrwins of prinxiry 
interest, measures of social, emotiohol, and other 
cognitive developnr>ent were used in sonr>e studies 
to provide a more holistic estinriote of student 
growth. 



Several such observational studies relating the 
compor>ents of educational programs to student 
outcomes were conducted (Soar, 1973; Stollings, 
1973; and Stollings and Koskowitz, 197^) in the 
evaluation of the U.S. Office of Education's 
hkitionol Follow Through Planned Voriotion pro- 
gram. The Follow Through program furxied the 
implementation of 22 nxxtels of education, based 
upon a wide spectrum of psychological and educa- 
tional theories and proctices. T>ie questions of 
interest to the goyernnnent were: (I) Were the 
programs as specified actually implemented in the 
classrooms? (2) If so, how did the students prosper 
in tfie programs? 

A study (Stollings and Koskowitz, 1974) of 
seven Follow Through models in 1st and 3d grades 
indicotes that the model programs were being 
implemented in many of the clossrooms. 
However, of even more iniportance was the 
finding that particular components of programs 
were significantly related to specific types of 
student growth. Many children seemed to prosper 
in reading and math in classrooms where teachers 
were very directive, used sequenced, self-fxicing 
programed nrKiteriols, provided extensive drill and 
practice Airing reading and nrxith periods, provid- 
ed imnr>ediote feedback for right or wrong 
attswers, and allocated approximately 50% of the 
schooldoy to these academic activities. These 
porticulor components were used in nrnxiels based 
upon the theory of behovior modification. Three 
models based upon this theory— the University of 
Pittsburgh's Individualized Eorly Learning Pro- 



gram, the University of KansQS*$ Behavior Analy- 
sis Approach, and the University of Oregon's 
Engelmanh/Becker Model for Direct Instruction- 
used a variety of organization plans. In one case 
teachers worked with one child dt a time, in the 
other two they worked with snrKill groups. Two of 
these nrKKiels provided verbal feedback; the other 
model included tokens with the feedback. One 
model hod group choral response; the other two 
hod individual response. The study identified the 
more global organization and management vari- 
ables. Each of the three models specified above 
also carried out very careful evaluations of their 
student week-to-week and year-to-year progress 
in reading dnd PTKith. 

Other findings (Stollings and Koskowitz, 1974) 
indicated that students in more open classroom 
models^ where students were encouraged to exper- 
Iment with materials and learn through inquiry, 
obtained higher scores on a test of nonverbol 
problem solving. These children also asked more 
questions about subject nrxitter and more often 
worked together on joint projects. The school- 
level evaluation of Follow Through models carried 
out by Anderson et al. (1977) found no consistent 
nnodei effect, but this evaluation did not consider 
classroom process data, only school-level test 
scores for each grade. 

Instructional Dimensions Study 

A summary of Title I evaluations by 
McLaughlin (I97S) suggested that most of these 
evaluations were unproductive and could not guide 
Federal policy. Therefore, the National Institute 
of Education was nxindoted by Congress in 1975 to 
conduct a study of purposes and effectiveness of 
compensatory education programs. These pro- 
grams were supported by Title I of the Elementary 
and Secondary Education Act (ESEA) and state 
funding. 

To ovoid the pitfalls of the large-scale studies, 
the NIE staff selected four major areas for study: 
funds allocation, service delivery, student devel- 
opment, and program administration. These areas 
were then sharply focused and total of 35 
separate studies were defined. 

The present poper deals with one .dimension of 
the student development area, the Instructional 
Dimensions Study (IDS), which was designed to 
evaluate the effectiveness of instruction provided 
to students in compensatory education programs. 
Based upon prior research, expert advice, and 
judgment, four dimensions of instructional 
settings were selected for study: pulloot and 
mainstream instruction, individualized instruction, 
content, and intensity of instruction. The 
dimension this author was requested to consider is 
individualized instruct ioo* 



Gxigress hod indicated an Interest In the '*use 
of individual written educotiondl plans for 
children." The NIE Study staff interpreted this os. 
an Interest of Congress in the performance of 
students in classrooms using this practice. The 
long step that hod to be taken by the IDS staff 
was to define what would count as an 
individualized program. Classrooms were to be 
rated on the degree to which they practiced 
individualization by the following criteria: 

• The assignment of specific learning 
objectives or octivities to individual 
children 

• The use of diagnostic and prescriptive 
activities 

• The existence of alternative learning 
paths and sequencing for individual 
children 

• The use of individual or small-grobp 
pacing 

This classroom-level orKilysis of process was o 
great step forward. Most previous studies of Title 
I hod ..addressed student achievement only and 
usually at the school level. 

Once the IDS started, the definition of 
individualized instruction wos narrowed so that 
teachers were rated on instructional techniques 
found primarily in the behavior modification 
models previously described in this paper. These 
diagnostic/prescriptive, direct-instruction tech- 
niques have received growing acceptance recently 
so that it is easy to understand why the IDS staff 
altered the previously stated definition of individ- 
ualized instruction to the following: 

• Clearly ■ stated behavioral objectives 
which take each student in small steps 
through curriculum materials 

• Individual diagnosis and prescription 

• individual or small-group pacing 

• Structured sequential instruction 

These were further reduced to four main ideas: 
establishing behavioral objectives, diagnosing/pre- 
scribing, individual pacing, and individual sequenc- 
ing. 

Thus, in the opinion of this author, the 
definition of irklividuolized instruction became 
quite limited. Diagnosing and prescribing did not 
fciegin to encompass the abilities identified by 
Guilford in studying individual abilities. Teachers 



were given a rating for individMlized Instruction 
bated on the extent to which they provided 
structured sequentioi materials through which 
students could go at their am\ rate to meet the 
objectives which were finally to iearn to cmcode, 
decode^ and connprehend written material. 

Teocher Reports 

The teachers at the conference were also 
troubled by the IDS operational definition of 
Individualized instruction. There were several 
interpretations of the terms. Most/ but not all| 
teachers believed that individualization required 
working with one child at a time while allowing all 
children to progress through the same reading 
program at their own rotes. Other teachers felt 
they provided individualized instruction within 
small groups. Diognosmg for some teachers 
meant diagnosing learning style preferences 
(auditbry, visual, or kinetic), while for other 
teachers it meant diagnosing encoding and de- 
coding skills. Some teachers diagnosed person- 
ality styles; i.e., some chilcken prefer to work 
alone, others can't work alone and need peer 
support; some need considerable praise and sup- 
port, ethers are intrinsicotty motivated; some 
need touching and holding, others do not. Thus, 
when teachers say, "Yes, of course I diagnose and 
prescribe," there is o wide difference in what 
actually occurs. 

Teachers also varied on how much of the day 
they spent in indivick^olized instruction. Some 
said they used it only for reading, for which they 
allocated approximately on hour a day. Other 
teochers sold they worked most of the day on a 
one-to-one basis with their students. Others said 
the amount of time spent on a one-to-<xie basis 
should be more for beginning 1st graders and less 
for 3d graders, who do not need as much indh^iduol 
help. 

For some, the individualization took place only 
in a pulkHit program, where the child is pulled out 
of the classroom for instructioru In this system, 
the ratio of students to adults was usually 10:1 or 
lower. Pullout programs varied in their structures 
from formal, well-equipped laboratories, some 
with computer terminals, to one aide working with 
one child in the hallway or in a closet. Also, the 
amount of time children spent in pull out programs 
varied. Some children spent on hour every day in 
the laboratory, for a period of 6 weeks; then a 
new group would go to the laboratory. In other 
coses, children would go to the laboratory for as 
little as 20 'minutes a day twice o week. 

These kinds of variances in the implementation 
of an individualized progrom, if not accounted for, 
could introduce substantial error into the analysis 
and might explain in part why no more effect 
could be attributed to individualized instruction. 



The teochers were frank in offering their 
opinions about the usefulness of indivickfolized 
instruction. Mo$f teochers felt it was too much 
work, but if there is enough space, if good aides 
ore avoilobie, and if the ratio is then 10 children 
to I adult (and if the airriculum is self-tedching), 
then it is possible to individualize for all children. 
But even with those conditions, many teachers 
felt that it was easy to get consumed by the 
progranr>ed materials. One teocher said, "When 
you have to hurry from one child to the next to be 
certain that oil children.get their instruction and 
feedback, it is difficult to get to know the 
children and see them holistically." 

Some teochers felt that children learn impor- 
tant things from each other— that they need to 
learn to listen to each other and this 'doesn't 
happen when they oil work alone. When discussing 
the idea of a story with a group and developing 
the vocabulary in the process, oil children hear 
the discussion and hove iTK)re opportunities to 
learn. Skilled teachers con involve all of the 
children In the discussion by distributing questions 
oppropr iote to each child's level. This is another 
way of individualizing, but one that leads to a 
spirit of cooperation. Other teachers reported 
that children working alone in workbooks at their 
own pace tend to worry about who is ahead and 
who is behind, and the faster children tend to brag 
about what page they ore working on. Although 
teachers may attempt to focus each child on his 
or her own progress and not on the page number, 
this is hard to do. 

Opinions of teachers also varied on the useful- 
ness of pulkKit programs. Some teachers felt that 
sending children from the classroom for instruc- 
tion was disruptive and posed problems wfien 
trying to fit the children bock into the classroom. 
Scheduling these departures was difficult, some 
children would then miss other activities, such as 
music, art, or physical education. Some teochers 
reported that the work children did in pullout 
programs was not coordinated with what they did 
in the classroom. 

Other teachers felt the pullout programs were 
o godsend. The children hod fun in the laborator- 
ies, where they could use new nxiteriols, play 
gomes, or use computers, and hove the total 
attention of an odu^t who knew how to assist th^ 
on their leve/. Meanwhile, the classroom teacher 
could attend to the needs of fewer children. 

The advantage most often voiced for individu- 
alization was that children do not hove to go too 
fast or too slow; they work at their own speed and 
at their own leveL Some teachers felt that the 
very slow children do not get emborrossed publicly 
when the teacher works with one child at o time, 
since oil of the feedbock offered is private. The 
frequent diagnostic tests of sonr>e curricula were 



also seen os on odvontoge. This process allows 
each child to move on to the next sequence of 
material when It is clear that the present material 
is mastered. The programed curriculum materials 
help to take the guesswork out of their teochlng* 

. Such materials ma/ help provide a consistent 
program much rteeded by a highly moblh society. 
Children irnoving from one school to oncther con 
take their progrmr^ed materials with them. They 
wouM not hcve to wait^Until the. new teacher 
figured out vtiere they' should start in a new 
reeding progrcm. 

In summary, the teachers* points of view 
^gording how instruction should be individualized 
were varied* No one position could claim domi- 
nance. 

IDS and Other Research on Individualized Instruc- 
tion 

Although the IDS found that overall the chil- 
dren in the study gained in reodingi the children in 
classrooms rated high in providing individualized 
instruction (objectives,' pacing, sequencing, diag- 
nosing/prescribing) did not gain more than did 
children in classrooms rated low on this variable. 
Individualized instruction is often organized as 
individual instructlon--one adult works with one 
child at a time. Individual instruction does not 
mean that on appropriate methodology has been 
selected for each child; still, It Is the varkible 
thought to be most essential by mdny teachers and 
program planners. Thus, several studies of ele- 
mentary ond secondary classrooms have looked at 
this classroom management style. These findings 
indicate that in classrooms where the primary 
strategy is to have one adult work with one 
student at a time, the gain for the total class is 
less then in classrooms where adults work with 
groups (smoir or large). In a study of 48 California 
3d grades in the Early Childhood Education Pro- 
gram^ a subset of 1 2 classrooms were matched for 
entry-level reading scores. Children In six of the 
classrooms made significantly more gains In read- 
ing than did children in the other six classrooms. 
From an analysis of variance of the two groups, 
we learned that teachers and aides in the gain 
classrooms were working primarily with small 
groups or the total group; teachers and aides in 
the no-gain classrooms were, most often, working 
with Only one child at a time. (Working with one 
child at a time occurred 2.5 times as often in the 
no-goln classrooms as it did in the gain class- 
rooms.) Students worked alone more than three 
times as often In the no-gain xlossrooms as they 
did in. ttie gain ckissrooms. Also, there was three 
times OS much misbehavior in the no-gain class- 
rooms. 

This suggests ttKit when students ore left on 
th»ir OMm ff% do SMtwork for lonoer Mrlods of 



time, or as they wait for their turn with the 
teocher, they may not get instruction and support 
as often m they need it and may digress into 
negative, or oS least off-task, bdhavlor. These 
findings were similar in the SRI Follow Through 
observation evolikition by Stallings and Kaskowitz 
(1974) and in the SRI study of teaching basic 
redding skills in secondary schools by Stallings et 
al.(l978). ^ 

Several clossroom process studies indicate that 
students\$pend from 40% to 70% of their time 
working alone (McDonald, 1975; Good, 1977; 
Stallings and Kaskowitz, 1974). In classrooms 
where teachers most often deal with one student 
at a time, the time alone increases. It becomes of 
utmost importance then, to find how to increase 
the time students ore actively engaged in leorning 
when they are left alone to do seatwork. 

How classrooms ore managed is a critical 
problem that has not received sufficient atten- 
tion. Indicators of poor management include a 
high rote of student misbehavior. Studies of both 
elementary schools and high schools report that 
nrilsbehavi>jr has a strong negative correlation with 
achievement. Thus, it Is important for teachers 
to provide adequate supervision ond guidance, so 
that children will stay engoged with their work, 
and it seems they con manage this best when 
working with the total group or small groups. 

Rosenshine (1977) summarizes the findings on 
grouping In the following way: 

The studies of primary grade classrooms point 
to tf>e need for adult monitoring and supervis- 
ing of student activities. Stallinos and 
Kaskowitz Follow Through Study (1974) found 
that time spent working with only one or two 
students, was negatively related to class 
achievement gain, whereas, time spent 
working with snrKill^groups (three to seven 
students) or with large groups was consistently 
po!?itively rated to achievement. Likewise, 
(1973) discovered that when students 
in groups under adult supervision, 
•.^i.^^Sations with ochievemeni were positive 
end ot!en significant. On the other hand, when 
small groups met without on adult, correla- 
tions between this grouping ... pattern and 
achievement were negative and often signifi- 
cant. A simple feet may be inferred from the 
studies cited: given that many students do not 
engage in on-tosk behavior unless a teacher or 
another adult is monitoring their ocodemic 
activities, the use of large group settings 
allows for more adult supervisloru Although 
many educators advocate working with one or 
two, such on arrangement precludes odequate 
supervision for the remaining children. As a 
result, most of the children have less academic 



It %Mould be Interesting to know whether In the 
IDS there was a higher rate of off-tosk behavior 
and less gain In classrooms where there was more 
time spent with one child, as found In these other 
studies. 

,/ 

Passible Explanations for Why the IDS Found No 
Difference in Effect ucx>n Reodino Between 
Classes Rated High or Low on InJividuolized 
Instruction ' 

The final IDS definition of individualization 
used for rating feachers does not specify who the 
teacher works with— one child, small group, or 
total group. It includes behavioral objectives, 
individual peeing, individual sequencing, 
diagnosing, and prescribing, rslevertheless, most 
teachers interpret individualization as working 
with one child at a time, and this iTianagement 
system has been found (as noted in other studies) 
were not. They were working with small groups or 
large groups, and to my way of thinking, that is 
not individualization." Therefore, they were not 
rated high on individualized instruction by this 
supervisor, even fhough they might have used 
sequential motericls with groups of students who 
established their ov/n pace. Another explanation 
of the lack of difference in progress between the 
two groups was suggested by a teacher who 
thought that many teachers placed in the low 
individualizing comparison group might hove been 
individualizing effectively in their own way but 
did not rneet the IDS criteria. 

What Hove We Learned and Where Do We Go from 
Here? 

This study hos contributed to our 
understanding that the definition the IDS offered 
of individuolized instruction (diagnosing erxroding 
ond decoding skills and placing students in 
sequenced programed materials, where they are 
allowed to progress through the materials at thf»ir 
own rate and finolly meet the objectives of being 
able to encode, decode, and understand written 
materials) is not sufficient to explain why some 
students prosper in an environment rated high on 
these variables while others do not. 

Although it is understandable, it is unfortunate 
(in this juthor's opinion) that the definition of 
individualized instruction was limited to the 
instructional techniques used in the structured 
diagnostic/prescriptive models based upon 
behayfor modification theory. These received 
eonsic eroble good press far improving the reading 
scores of some children, but to coll the proctices 
of diognosing encoding and decoding skills and of 
pocing students through the some sequence of 
material "individualized instruction" is 
shortsighted. This does not seem to be what was 
meant by the Congressionol interest in programs 



that ^ise Individualized written educational plans 
for children." 

Children In any classroom hove many qptltudes 
and limitations; no one method is likely to work 
for all students. The National Reoding Council 
reports that the 20% of students with reading 
problems are not aided by present classroom 
methods and that the percentage of students with 
reading problems who ore, falling remains the 
some todoy as 20 years ago. Clearly there is a 
need for a more extensive diagnostic program so 
to be ineffective in promoting academic achieve- 
ment. Such o monogement system could wa^ out 
the good effects of individual pacing, sequencing, 
and so on. 

/ 

The findings reported from the research do not 
suggest that individualization, as defined in the 
IDS, is ineffective? the findings do have 
implications for classroom organization and 
management of time. 



Other portions of the IDS definition of in- 
dividualized instruction ore found in studies on 
research in teaching by Brophy and Evertson 
(1974), Good (1978), Stollings and Kaskowitz 
(1974), and Stollings et al. (1977, 1978). These 
studies find positive correlations between reading 
achievement and specific components of directive 
teaching. These components include direct ques- 
tioning, answering, and feedback procedures. The 
children ore - tested frequently and placed 
accordingly in programed materials. The materi- 
als ore carefully sequenced, and all children either 
show mastery of the oKiterials on criteria tests or 
ore cycled bock through the sequence. For the 
most part, children are grouped by ability level, 
and instruction, drill, practice, and feedback ore 
provided to the group. Children nrwy move from 
one group to another if their achievement surpass- 
es that of the group. Findings from these studies 
suggest that in ckissrooms where significant read^ 
ing gain is made, approximately 50% of the 
schoolday is allocated to academic study of the 
type described. Thus, if the amount of time spent 
in reading is not accounted for, the value of the 
direct instruction or this individualized approach 
may be lost. All of these factors ore undoubtedly 
linked together, and when they ore dissected to 
consider the impact of eoch separate port, the 
effect of the whole'is lost. 

In the IDS, the definition of individualization 
had similar component names as those in direct 
instruction, but the actual events occurring in 
classrooms with those labels may be quite 
different from the events identified in the 
reseorch under the some label. That is, the lock 
of effect tt>e IDS found in the classrooms reported 



to be more individualized carNije understood in 
light of the different definitions tetKrfiers offered 
for sequencing, pocing, diognosingy/ond prescrib- 
ing. Teochers' self-reports and suoervlsor's orkl 
observers' reports were not consMtent. One 
supervising teocher 3aid, "The teoch^s I supervise 
said they were individualizing, but I said they 
that perceptual, motivational, enrK>tional, and 
neurological problems con be identified. Many 
schools provide only reading encoding, decoding, 
and comprehension diagnostic dot a. 

Perhaps treatment for reading problems should 
include eye exercises and kinesthetic octivities as 
well OS drill and practice on short sequences of 
Informotion. Given particular abilities, we still 
know very little about what is optimal for some 
children to learn, and particularly how they learn 
to read. Thus, I think we need to move down one 
more level: we have moved from the school level 
to the classroom level over the past decade, and 
now it is time for studies where individual 
students are the level of analysis. Building upon 
work described by Cronboch and Snow, well- 
designed aptitude treatment interaction studies 
ore needed. 



It would be unwise to conclude from the IDS 
that indlvtduolized Instruction is not good for 
students. Children who receive a few minutes of 
Individual instruction while the rest of the class 
raises havoc may not have the sane opportunity 
to progress as children taught in small groups, but 
individualized instruction aimed at meeting the 
needs of individual children whether in a group 
setting or in a one-to-one setting has not been 
tested in a way that would show whether it works 
or not. 

Approximately 80% of the students probably 
did make progress under the approaches used. The 
20% .who did not may have hod other problems 
that went undiagnosed, and 'thus untreated, in the 
IDS. We do not yet know who thrives where— 
Benjamin Bloom predicts that 99% of the students 
in school con learn if given appropriate 
instructional opportunities. It is the job of the 
teacher and researcher to provide the appropriate 
instructional opportunities for each child. This 
study is 0 step in the right direction, but there is 
still 0 long way to go until each child con progress 
in school and obtain his or her right to a 
functional education. 



BIBLIOGRAPHY 



Ancierson, R. B., et al. Education os Experimento- 
tion: A Planned Vqriqtion Model. Vol, IV^?. 
Report No, to the US. Office of 

V Education under Contract No. 300-75-OI34. 

\ ,Aprill977. 

Bloom, B. $• Kjman Chorqcteristics ond School 
Learning^ New York: McGraw-Hill Book 
Company, I97S. 

orophy, J., and C. Evertson. Process-Product 
\ Correlations in the^ Texas Teacher Effect 
\ tiveness Study; Final Report . Austin, 
Texas: Kesearch and DevelopnDcnt Center 
\ for Teacher Education. 

Crorlboch, J., ond R. E. Snow. Aptitudes and 
\ Instruct ionol Methods . New York: Irvington 
publishers. Inc., 1977. 

Good, \T. L. The Missouri Mothematics Effective^ 
ness Project . Columbia. Mksntjrl- ^^wJ 
Education, University of Missouri oi 
Columbia, March 1 978. 

\ •■ ' . - • ■ 

Good, T.; and J. Brophy. "Analyzing Classroom 
Interaction: A More Powerful Alternative." 
Educotiono! Technology |2*36-AI, 1971. 

Guilford, J. P. The Noture of Human Intelligence . 
New yoric iWcGrow-Hill book Company, 
1967. , ^ 7f 

\ 

Jencks, C. Inequality, a Reassessment of the 
Effect of Family and Schooling in America ! 
New Yo*-k: Basic Books, Inc., 1972. 

McDonald, F. J. "Report on Phase II of the Begin- 
ning Teacher Evaluation Study." Journal of 
Teocher Education. Vol. 27, No. \, spring 



McLoughlin, M. W. Evoluotion ogd Reform: Th^ 
E'c'Tj>«itqry ancTsecondary E lducotio n AcTpf 
Ty73, Title K Conribrldqe. MajgcochtK^^tf^ 
Boillnger, 1975. 

Mosteller, F., and D. Moynihon (edj.). QnEquglitv 
of Educational Oooortunity. Klew Ydrl? 
. Vintage Books, I §72; 

Rosenshine, B. Primary Grades Instruction and 
Student A chievenient Gain . Univ^sity o7 
Illinois, 1977. 



Soar, R. Follow Through Process EvoluatiorL 
• 1970-1971. Cioinesville, Florida: Institute 
for Human Development, University of 
Florida, June 1973. 

Spady, W. G. "The Impact of School Resources on 
Students." jn F. N. Ker linger (ed.), Review 
of Research in Education . Vol. j. HtascaT 
Illinois: f. E. Peacock Publishers, Inc., 
1 973. 



Stall 



lingSf J. Follow Through Program Classroorti 
Observation Evaluation J9?U|j?g r"^'WgnK 
Kark, California: Stanford Research Instil 
tute, 1973. 



Stollings, J., and D. Kaskowitz. Fplloyy Thro 
C lassroom Observation EvgluotibnTT^^ 
1973. Menio Park, California: Stanford 
Research Institute, 1974. 

Stollings, J. et al. Early Childhood Ed u cation 
Classroom Eyoluation . Menfb l^orfT, 
California: SRI International, November 
1 977. 

Stollings, J. et al. A Study of Basic Reading Skills 
Taught in Secondary Schools . Menio Pork, 
California: 5KI International, January 1 978. 



EKLC 



